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.A&STRACT^ , • ^ 

This report documents the im.ple mentation and 
evaluation of a oile-veek competency-based voorkshop on designing 
learnj^ng systems ^or coordinators apd curriculuns development 
''specialis;ts of^the West Virginia '^Department of Educrtion, Division, of 
Instructioj^ Learning Systems. The main objectives of the workshop 
wer^: (1) development of an innovative .learning system njodel; (2) 

thip training of staff to become state-iiide change agents toward model 
implementation; and (3) the subsequent performance of instructional 
))ehavioTs demonstrated by the workshop learders. The material*^ is 
presentled in the following f orjnati^- .(^1) *in trod action ; (2) planning 
'phase; (3)' participant characteristics; (4) workshop evaluation; (5) 
conclusions; (6) .reecmmendations ; (7) reference:^; (8) apperidipes 
„ (workshop instructional materials, data ^collection instrumen,ts) . 
Reconimenda tions drawn from ^the experience were that: (1) the elements 
of the systems md^el developed* in the workshop should be used by the 
curriculum leaders as. a diffui^on strategy; (2) follow-up da|ta on 
participants' on-the-job behaviors regarding mo&el implementktion 
should be gathered; (3), the use of the competency-based workshops 
should be considered seriously, by other state department .of .Education 
bureaus and divisions adopting innovations for their staffs and (4) 
tha^^jise, of full- or small-group f ollowup sessions for staff aembers 
requesting or requiring aid in the implementation of the learning 
systems model should be considered ty]jt£i^J)irec tor of the Division of 
Instructional Learning SystVms, {fHH'Bf^^^ 
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FOREWORD 



Educators are/befng asked to approach their professional respibns i bl 1 - 
ities with a degree of quality never required before during the h'fS*tory of 
professional education, v Consequently , a major leadership roTe of the West*^ 
Virginia Board of Educat ion^and the West Virginia Department of Educatjin 
is that of^ an advocate, espowsirig^ urging, and speaking out for educational 
Improvetment and needed change in the areas of inservice education and con- 
tiny jng 'educatton. \^ ' • { . 

The purpose of A Competency-Based Workshop on Designing Learning 
Systems for the West Vlrgitiia Department of Education, Division of Instruc- 
tiona] Learning Systems ^Staff is to provide an example which generates sub- 
stantive evidence for implementing and evaluating inservice workshops- 

t believe'this publication will stimulate thinking ^nd provide insight 
pertaining to the desfgn, development^ imfJlementat ion ^ and evaluation of 
inservice workshops and continu^^rg education programs'. « 



Daniel B. Taylor 
* State Superintendent of Schools 
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PREFACE ' 

• ♦ . . * * 

The Bureau of Learning Systems beUeves that a^majpr portion of Its 
responsibility Is stimulating ^nb assisting educational commupltles In es- 
tablishing and maintaln'^g a. learning system.' This mission translated Into 
a goal statement ne^es's I t^tes the [provision of programs for the devel opment 
of Ijnowledge,, skills, and attitudes necessary for: educat loijia^ personnel 'to 
,suppo'rt the attainment of the. Educational Goals For West VirginFa. ' 

^ The demand for quality In teaching Indicates that generalities and 
pJSaliitades ^f the past be replaced by pr^cis^ description. This mfeans in- ^ 
service workshops, Inservice education, and^ con^t i/iu Ing education ventures * 
must provide specific v^r^iflable changed Instead of.inere talk of progress," 
Therefore, inservice workshops, Inservice education, and continuing educa- ^ 
tion prograa)S 'must be designed to meet the idehti/ied needs of professional 
educators rather than workshops and programs that are externally prescribed, . 

^ Cpnsequently , the instructional behaviors, programs', and materials 
develops^ for inservice*' educatjorv and continuing education proqjiams must be 
sys.tematic, st fmul at-i ng, psychologically sound, organized, and planned with 
Instruct I onal materials andc media l!o meet the needs- of the participant, 

A Competericy-Based Workshop .^on .Pes Ign i ng Learni ng Systems fpr the 
' West Virginia Department of Education, Division of 1 nstruj^t ior\al Learning ^ 
Systems Staff exemplifies the problem-solving process using a systems 
approach. The document serves as a model for de^signlng, develop*fng, imple- 
menting, and evaluating inservice workshops and continuing education programs. 

The Bureau of Le.arning Systems and the Division of Instructional Learning 
Systems are committed, philosophically and psychologically, to learner-based 
dec 1 sipn-maki4ig. Although the entire staff of'the Division of Instructional 
'Learfiing System? was the focus of this inservice program, personnel.. were 
involved on an individualized and personalized basis. 

' Thq Bureau of Learning Systems wishes to extend acknowledgements to the 
laut^iors of this document and a special, note' of gratitude to the^personnel of 
the Division of Instructional Learning Systems for" their involvement in this 
project'.^ In addition, thanks is extended to Merrill ^L, Meehan for Iji s efforts 
In designing thereover pf this document. 



Phil E', Suiter 
Assistant State Superintendent 
Bureau of Learning Systems 
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INTRODUCTION 



State departmepts of education have undergone considerable role changes 
since their inception. At firs^t, state departments of edupation focused on \ 
regulation; i.e., the making of rules, maintenance of records germane to \ 
those rules, and enforcement of the regulations when appropriate. The second 
stage in the development of the role. of 'state depart-^ents of education was 

' ' ■ ^ \ 

that of providing much heeded services to local school systems. Currently! 

' * * »■ * j 

while the i^egulatory and service funct ions have become operational, the focus 

- 1 

■1 

is* on tlje leadership role. For example. West Virginia's Superintendent of [ 
Schools sayst "The role of the State Department of Education has become that' 
of. an advocate, espousing, urging^ and speaking out for educational improve 
ment aod needed change*' (Taylor, 1975, p. B)\ . ' 

One of the major state departtjrfent of education leadership functions Is 
to stimulate activities dealing wi-th- innovative educational practices, f^r^r 
sumably, such activities will result in educat i ona 1, projects , usually in^ the 
form of models, that are transferable or. general izable to school systems 
vnthin the State, Assuming that such innovati Vte. m oddl s are reliable and 
val i d^', *then interested parties might, consider' thel r ajpipptionTor adaption for 
their own use, - ^ ^ V f 

In the West Virginia Department of E<jiuca^ifelf ,,^e %b of Leafnlag 
Systems Is organized into three ,d Ivi s ion^i^* ir5¥qg the'^^^^anagement 
>app>oarth, the divisions are responsible fdf* ttTe^'ljbplementatlon of the three 
broad goa/is of the Bureau. Among the planned actlvitl^0$ prpjecte'd t6. e^phleve 
these goals, each of the divisions of the Bureau, during the 19^5-76 schoot'>. 



^year^ Implemented a leadership role and a new organizat iona-1 structure. 

Accprdlngly, a Bureau,^ps i t ion paf)erydeve loped internally indicates that: 

'*Staff should^iduct appropriate staff development sessions dealing with 

the new Jeadj^rfhip ^lole'*' (Bureau of Learn ing Systems , . n. d. ) . 

The purpose of this. report is to document th6 implementation, and evalua- 
' *''*»' • 

of a one-week competencyrbased workshop held in January, 1976,. on designing 

f . ' ' * 

learn ing systems for the coordinators and curriculum development specialists 

-rof the DIvlsiort of Io5trufctional Learning Systems. "The main thrusts of the 

Workshop were the development of an inf^ovative learning system model, training 

the staff to becom^ statewide change agents towajfds i ts Mmplementa'tioh and 

subsequently perform the instructional behaviors demonstrated by the^ co- 



leaders. , • ^ ^ , 



RELATED LITERATURE • . 

The literature review foci were educational . innovations and the concept 
of change oi^Ientation. * 

, Several schema for -classi fying educational innovations have been pro- 

•N • ^ < ^ 

posed; they^are usually differentiated on the basis of the theoYet'fcal 

tfamawork assumed by the classifier, Innovaljio^ns have beerj^xrlass i f^ed most 

r * ' \ :/ ' • ' 

often by their Jntended outcomes. ^Following this fr'amework, then, typical 

outcomes focused on: (1) t he cu rriculum, {2} i' astruc t iofial practice^ 

(3) educa tional technology, and [k) educational admi ni s'tr'at ion. Jiowever, "^'^^ 

: . ' • ■ ■ •/ , - - - 

t^^e possibility of interaction among these classifications exists and does 
occur loften in practice*. ' " ' . « » 

Not ^11 educators agree that inqovations in*their fields can be class- 

^ ; - ' . ■ ^ A- - ■ ' » ^' 

ified. Hull and We'Jls ( 1972;) , attempted to^classify i nnovat ions Jn their 



field df.^ducation and develop a guide for evaluating innovations thus 
classified. They found that "A taxonomy of innovations was deemed not 
possible with the preseW level of knowl edge , and technology.' Innovations 
were djfficult to define'^' (p. x) . ^ , ♦ 

The Educational Programs for Innovative Cyrriculum '(EPIC) developed an 

evaluation model for organ i^at ional • s tructures a^ffecting educational programs. 

^ ' ^ ' ' V- ; , ' 

The thr^e dimensional .structure included'^'the following variables: behavioral 

i ' ' , > * 

*■ 

characteristics, instructional characteristics, and' i nst i tut iona-1 character- 
istics (PDK National Study Committee on Evaluation, 1971). Each of three 
variables contained levels which t»hen formed cells for classifying eduqa tion^^ 
Vj?^''Pyograms,x / . • ; j . • ^ ^ 

vAl though innovations are pop^ular topips <^ conversation and jnany are 
vogue at any given time, numerous problems arise when educators attempt to 
implement innovative. programs. There are, however ,^some generalizations 

< • , • ^ • . / ; " . ' 

-i"^'*^ which aid in the*adoption of educational innoxt^tions. 

^l^sfc-^ The context in which an innovation is developed plays a large role in 
aciy future adoption or adaption. Some innovations may work well in one 
coljtext but fail miserably in another. The community, political, profes- . * 
I^'l sionaJ , and economic contexts are some of the important, variables in th^ 



implementation of an innovation. VariatiSn^ between these .variables may be 



more^44Tjportant'"than objective information about the outcomes of a parti^^ular 

innovation urrd^j:^^consfc} ^ration. Mi.les (T964) states that: 

^ Educat iorTTrinbvat^ are almosl never installed on their, . - 
merits. Characteri^tfcs'of the '^ocal system, of the inno- ^ • 
vating per^n or group, and of •other re»levant groups often 
outweigh theMmpact of >fhat the innovation is. (p. 635) * 

^ The 4)rofes$ iena 1 . and economic contexts may beuthe most often cited 

constraints inhibiting the adoption of, an innovation*. The fii^t requir^ent. 



\ 
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of any proposed cttenge is that its goals^and objectives 'are clearly underwood 

by all the professionals involved in it^ execution. However, differ-enciBS Jn - 

values, attitudes, and perceptions are bound to exist. In school settings, 

administrators are. most often the deci sion-maker 'concernfng the adopti.on of 

new programs but' the "intpl em^entors" are'rffost often the teachers; in their 

if , ' * . ' ^ 

hands* rests the^ ultimate success (or failure) of an innovation. Al$o, any^x^ 

• »^ ^ (, 

Innovation requiring additional resources, either jnoney or t-ime anj^^ergy 

which equals money, is bouiid to. be adopted slower than exp^ir^e-f ree innova- 

tions. Hull and Wells* *(1.972) research found that^admi n i strators possessed 

an "almost uniqu^e corrt>^rn" (p. k\) f^r the>rfnovati on ' s ^osts and -sources of 

financial support when compared tOySrH other involved groups. 

Rogers* (1962) di f f us rprfresearch is the benchmark study far the'use^of 

adopter group label s< He devised the lowing labels to identify the va^rious 

adopter cat^j3<5ries within a population: innovators, early adopters, early 

majoivrly, late majority*, and laggards. These adopter groups fit the nx^rmal 
# • ** 

curve as far as relative, time of adoption, is concerned (p. '162). It is 
inter^est i ng* to note that only 2.5 percent of a population ,f it into the 
innovator group. . ' * • 

. IJumerous change agent guides have been de^^eloped to assjst innovators^ *• 
in the adoption process. Havelock (1970) prepared a gyide reflecting his 
definition of innovation as a process.' This guide emphasized the change 
proems areas qf: relationship,' diagnosis, acquisition, choosing, acceptance, 
.and sel f-'renewal . Bushnel 1 (1 972), formulated a six-step change process '^in- 
eluding; diagnosis, object ives , const ra i nts , potential solutions, eval'uatjon, 
and -implementation. Other change process guides with similar cat^gori^s have 
been proposed* . * . 



The potential adopter of "an innovation needs to consider its implemeVita- 
tion fn terms of changes it demands of individuals. Lippitt (1968) focused 
on the individuals i nterna 1 res i stance to experimental programs. His study 
revealed innovators neeH to understand factors wifhin themselves before they 
can seriously comrpit themselves to change to new ways of doing things* 
Lippitt feels that ^'Usually dissemination agents^ do an "i nadequate .job of 
♦ helping the potential adopter explore realistically the question: "Well, 
• how i^ould this fit in my situation?*" (p. 42). * ' . , 

Jbe^ attitudeV'Df^nd! viduals representing the existing system become 
the locus of attention for the. change agent.. The- importance of att^itudes in 
a perspn's behavior is a major tons i derat ion The necessity for determining 
individual attitudes and un?Jerstand i ng their relationships to behavior was 
emphasized by Hoi loran (196.7). He feels that "If we .know sofnethi'ng about 
ajj.'-lnd fvidual ' s ...attitudes... it helj>s .to mdke sense and give meaning to 
individual behavior and, in all probability, it is the best basi.s for predic^ 
tion yet devised", (p, 28). , ' ^ . . 

• l^ussell's ('1972) reseafch concluded thaVt^chers* attitude^ toward 
educational change is reliably meas.urable. Using ,the Change Orientation 
Instrument especially developed for his study, Russell found, that "Early 
adopters, as a group, have '^significantly higher total change ^orientation 
scores t^an the laggard group" (emphasis in the original, p, 48), Using . 
the same Change Orientation I nst rument, .Adamsky. (1973) found "that the 
correlation between the ^teachers * o;"ientation to change and their adoption 
behavior [of using* behavioral objectives] was positive and .statistically 
significant" (p. 101). ^ - . ^ 

Hodgkihson (197^) sought to discover if there was a relatlopshif) between 
an \r\iiy^ua]\^y)fB]ues and his orientation t^ change and, if.so, which values 

■ ■ ' ' .• . 13'' , 



were they? He foi/nct^slx values Which correlated significantly with change 
^^-/^ri entail on. "The individual values equality, true friendship, wisdom, 
i^^^^^k^^'^"^^' logical were ranked higher for innovator/early adopters 
#d the value innec harmony ranked higher (lower numerical rank) for the 
laggards*' (p. 54) . 

Rogers and. Shoemaker (1971) identi f ied the five most important char- 
acteristics of innovations* which explain much of the i r»adopt i on rates: 

1. Relative advantage is th^ degree to which an innova-^ 
tion is perceived as better than the idea it sqper- 

- seded . ^ * • 

' ♦ * * > 

2. Compatibility is the degree to which an innovation 
. / .is perceived as being cons istent wi th the existing 

values,, past experiences^ and the needs of the 
receivers. ') 

4 

•3. Complexity is the degree, to whi4h an innovation is 
pferceived as difficult to understand and use. 

k. Trialability is the degree to which an innovation 
may be experimented \r7ith on a Ijmited basis. 

5. Observability \s the degree to which the results 

of an innovation are visible to others, (pp. 22-23)' 

•WORKSHOP PLANNING PHASE 
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la yearly Dedember, 1975, the workshop ^co-leaders met with the Directors , . 
of the Division of Instructional Learning Systems and the Division of Profes- 
sjonalji^evelopm^nt Systems to formulate the learning system model , ^e^stabl i sh 
the workshop goals," and plan the general instructional strategy. 

LAn underly ing.^i^sumpt ion of the workshop planners was that an innovation-- 



r^as th^ learo/ng $V!|<,tem^y mod^l ^-i s an / ^fea or practice perceiyed as new 
by an yndlvid.ua 1 ; it matteri little if the i^ea. or practiceJ^ obj 



iect i vBly 



new. This not^n gLip(^d^tli^/%orkshop planners in the development of , t6^ '^'^ 



learniog system model/ and the workshop instructional straljfcrgy. ^ ^Jy^j-^-' o y^B^ > 

14 ■ ■'. 
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The learning system mod§l developed by the workshop planning group was. 
an expansion of the basic '^irtput-processe's-output wi th a /feedback loop"* 
model from systems analysis. The planners adapted the ir\structional model 
presented by Kibler, Gegala, Barker, .and Miles (197^). Additionally, son^ 
concepts'and terminology presented in Learning Syst^ Dgsign by Davis,, 
Alexander, and Yelon-(l97^) were 'adapted ihto t^he leaVning system model. 

Figure 1 illustrates the learning system model developed for the work- 
shop. .The learning system model consists of the following seven elements: 
rationale, objectives, preassessment , instruction, sel f revaluation, evalua-/ 
tion, and feedback. At two points ih the model, the learner decides to take 
one of two alternative courses of action. ' This model was conceived as an " 
t'nnovatlve practice for the Division of Instructional Learning Systems staff 
to learn and utilize in'the,|r primary job function. Also, it was thought by 
the. v^rkshop planners. that a spin-off from the model" was that its general 
systems approach would be applicable to the staff *s other divisional respon- 
.sibifities such ^as projecled a^cti vfties, budget, conference, committee, and 
communication functions. ^ , r^'^ 

Six broad workshop participant goals were formulated by th§ planning 

I. 

group. First, the worksrhop aimed at haying each participant accept learning 

system design as a viable educational practice. Closely allied with this 

'a* ' ^ . ^ ' ' ' 

was the second goal of leaving each participant recognize and/or match his/her 

instructional values wi ih {he characteristics of cdmpetency-based education. 

The third goal.v/as to h^ve each participant share his/her expertise and as'sist 

colleagues in achieving t4ipe workshop pbjectives. The fpurtti workshop goal 

'required each part icipanjL^o wri te instructional objectives reflecting the 

domains and the*r leve]s of behavior. Fifthy^the workshop sought to have 

each participant analyze the elements of the learning system mo^el ^s 
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Figure 1 ^The Learning Systeiil Model 
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presented in the wqrkshop. Last, each workshop participant was required to 

design an original example learning system appropriate to his/her divTsional 

responsibilities. These six goals stated as terminal objectives an,d their 

related enabling objectives are appended to this report as Exhibit A; ' , 

Thg^l^^essfi^l implementation of the innovative learning^sye^tem model 

requirferd t]p lnstrudt,^^j^i^strategy of conducting the workshop (process) to 

reflect the learning systeUfi <ie5igri (product) that the participants in turn 

develbp. Both workshop 'co-leaders had utilized this approach successfully in 

. # 

previous workshops and institutes. Details of this instructional strategy 
have been explained by Hobar and Pries^ter (197^) and Meehan (1976). Basically, 
the emphasis is on the individual"workshop participant to peqiForm required 

./-■.' • • ^ 

^^competencies^ rat;her than njerely possess knowledge about them. Hobar and 

ester (197^) explain the instructional strategy thus: 

" In actu^J--Jpp1 icat ion, workshop participants are encour- 

^ aged ax X^e outset to establish openly "CKeir beliefs 

- about in$!l4HJction and learning and to. formulate their 

objjsctiv^^ for the workshop. Next, the workshop partic- 
ip'ant^S^-'J^i'e given the terminal and enabling objectives ' ' 

-45- "z^... - ' • for -the V^orkshop--thi s composite of participant and 

consuHents objectives establ i shes the learning 'targets*- 
<^ ^ to be mastered in the workshop. Following informal and 

^ formal preassessments , th^ workshop participants advance' 

at their own learrting rate toward mastery of the objec- 
^ N' tiyes within the time limitations of the given workshop," 

Under these circumstances, the workshop participants* 
aptitude cr i teri on t imel i nes~ (t ime needed to 1 earn) are'^"' 
• facilitated by an^array of personalized learning alter- 
natives and stimuli, individualized and small group ' 
\ conferences, peer appraisals, negotiation of ^criteria, 

_ _setf -evaluation, and formative and summative evaluation/ 

rcpT 3) ^ . " ■• ■ 
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WORKSHOP. PARTICIPANTS - ' 

The 19 workshop participants included the full-staff of thekDivision of 
Instructional Learning Systems less the Director and his Assistant, Three' / 

. • ■ ' . \ ■ ' W- • / 

EMC., • ■ ; 18 . \ • * ' 



part Ic I pants -were coord i natCrs for specif iq T^els of schooling, one par- 
tfc'^lpant was the coordinator for school accreditation in the state ^nd the 
other 15 participants were curriculum development specialists for particular^ 
subject disciplines such as language a^ts, health education/music>^or 
industrial arts education. Data on the participants * sex, age category, 
educational level, number of years of teaching^ experience, number of years ^ 
of administrative exper ience , and the level of school in^* most identified 
with were elicited on a Personal Data Questionnaire (PDQ) administered during 
the wbrkshop. 

The workshop participants included ten males and. nine females. Their 
ages ranged from the 26-30 category to 'the 6I-65 category; ten.pf thg par- 
ticlpante were between the ages of 36 and ^5, five were between the ages pf 
26 and 35, and four were between. ^6 and 65. The master* s degree was the 
highest educational level attained by two part ic jpants , the niaster's degree 
plus additional credits was the level of 16 parti.cipants, and one participant 
had an earned doctor's degree. The mean nu^mber of years pf |:eaching^xj)^r ience 
for the group was 11.53 with a range of 3 to 48 years.. T^ mean number of, 
years of supervisory or administrative exper ie^e.y/as 8. with a range of 
one-half to 22 years. Five of the participants identified or dealt most 
with the elementary level, nine participants identified with the secondary ' 
level, and five of the participants dealt with the-elementary and secondary 
educa t i on 1 eve 1 s comb i ned . 

The Assistant 1:0 the Director of the Division aided in the implementation 
of the workshop by serving as an omsbudsman between the workshop co-leaders 
and the participants. He also performed the services of: ^assisj^ing in 
discussions; conducting individual , conferences; relating to certain partic* 
ipants; providing formative evaluation feedba^; providing clarification. pf 



ciiyislonaf responsibi 1 1 1 ies; arid schedul ing-audio-vlsual equipment, con- 
ference space, aVi/l typists. ; 



/ ' 

/ ' WORKSHOP EVALUATION 



The po^sture assumed by fhe workshop planners was that the eva luat ion 
effort should be rooted in the process a^id product of the worksljop. Stated 
differently, outcome? should be consistent with the workshop goal s and in- 
structional methodology. Assessment of the workshop processes and products 
was conducted via a preassessment device administered before the workshop, 
a set of instrumfents administered durin^^the fir^t<and last hours of the 
workshop, arid by the maintenance of a master performance record for the 

group. ' ' " ' , ' 

y ^ 

A J2-item preassessment checklist, serving as a '^diagnostic device, was 
coitipleted by each participant al. his/her woi;k station approximately tw6 
weeks before the workshop. Analysis of the preassessment checklist responses 
i^lidicated the general *level of perceived competence each participant reported 
for the wprkshop goals. Based on these checklist responses, groups of indi-^ 
viduals requiring similar types of instructional assistance were identified / 
prior to^the actual workshop. ' • 

The most important focus of product evaluation involves the number of 

• >" ^ ' 

participants successfully achieving the expl icitly stated workshop enabling 
objectives which were .made public prior to instruction., Jh6 20 specific 
enabling objectives were collapsed into 10 .performance record statements as 
shown Appendix A. Assessment^^s of these data help analyze the effec- 
tiveness of the mastery learning approach of the workshop. Bloom, Hastings, 
and Madaus (1971J express the view that *'given sufficient time and appropriate 
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types of help, 95 percent of students ^ (the top 5 percent plus the. next 90' 
percent) can learn a subject, with a high degree of mastery" (p. ^6). The 



onus IS on instructors to select strategies that will' take individuals^ 

differences in terms'of characteri stjc^ and needs i nto x:ons i d«rat ion in 

helping learners achieve mastery of .learning tasks. Partjcipants were- 

encouraged to recycle products till criteria were met .and various tactfcs' 

were employed toward meeting the individual differences of the workshdp 

participants. < r ^ ^ 

Table 1 presents n^stery of the performance record .statements data- for 

the workshop participants. All 19 p3rt i c*i pants mastered seven "of the 10. 

... • * ♦ " • • 

performance rej^ord statements:. Performance record statements two, seven, 
and e;^ight were mastered by 18 of the J9 participants. For thfe entire group,. 
187 out of 190 perfonmancje repord stafeiments. were mastered for an overall.* 
completion percentage rate of 98.4^. This figure strongly supports the , 
position taken by Bloom, Hastings, and Madaus concerning the mastery learning' 
concept. Moreover, thgre is every reason to believe that allowing more time 
for completion would be meeting the individual needs and charact^er i s't i cs df 
thos^ participants not demonstrating total mastery l^y the closing hour of 
the intensive five-day workshop. " 

The Values Inventory Page^ (VIP) was a simple "paper anfiS per^ci 1 device ■ 
to ascertain participants* sel f-Veports of importance given the values . • 
equality, true friendship, wisdom, imaj^ination^ ^logic, and inner harmony. ' 
The purpose of the VIP was an attempt to ideatify'the early adopters and 
laggards within the group by extending Hodgkinson* s research. Each par- 
ticipant indicated the importance he/she gave eacb'value by marklng^a point 
dn a 1 to 10 continuum (ten being the highest point value). Next, they ranged 
the^yalues on their importance from one (the highest) to^six (t^e lowest). ' ^ 
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Table 



Mastery, of Performance Record Statehients^ by Participants (tJ=19) 



Performance 
Record 
Statement ' 

1 

s. 2' 

•3 , 
if 

5 

^ 6 
7 

9. 

Id ' 



Number of 
"Participants , 
Completing 
Mastery ^ 



,19 _ 

19 

19" 
19 

18^ 
19 
1 9 



Percent 
Complet Ing 
.° Mastgryb 



100 
9^.7, 

roo 
100 
100 
lop ' 

9^.7 
VOO. - 

iob 



. a 



See text and Exhibit A for 'an explanation of these statements 

The overall completion rate fpr all performance record ' statements 
by the total group was S8.k%. . ' ' ' " , 



In scoring the VIPs, it was determined that, the workshop part4cipants 



were reluctant to d^jiJ^feVent lafe vsthe importance they placed *\)n the->m. >?^1 ues 
as noted by; (a) several participants marking "ten*' for afl six values; 



(b) some part icipantg. chose.not^to complete this portion of the m/^s^ rumen f;' 

and (c) others wrote question marks over the value scales. However/' it w^s 

possible to score the part i ci pants V rahkfngs of the values. The combined 

. ' ? * ' ^ < 

part icIpaVits* rankings of the six values before and after the works^iop appear 

• -~ ^ ' • ' ' ' ' - 

in Table 2. Ope obsdrvatlW gleaned from, the data .dTsplay is t^at the grodp ' 
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Table 2' ► ^ i 

Participant's*. Ranking of Values Beforehand After the Workshop , 



Before Workshop . ^ Atter Workshop 

1 ue Rank i ng Ranking" 



f 

wisdom 


# *■ 


1 








1 
















1 nner Harmony - 




2 










True Friendship 




3 






















Equal Uy ' 


* 1 










3 • 


Logic 




. 5 


% 






5 


Imagf nat ion 




6 








' 6 

















as a whole ranked the vaTue inner harmony second fcoth before and a^fter the 

workshop. Recal'l that Hodgkinson found this v^lue to be correlated signif- 

t 

Icantly with change orientation: inner harmony rankj^d higher for the laggards 
than t;he early adopters* Also,lother than the change in the ranking positions 

/of true friendship and equality before and after the workshop, *the values were 
ranked rather consistently by the group, 

•The Self-ratings of Workshop Topics (SOWT) instrument elicited partic- 
ipafits* self-reports about knowledge and experience of ci^rriculum concepts," 
Curriculum topics specifically related to the workshop were contained in a , 
list of 23 curriculum concepts. The sel frrat ings response range* was a con- 
tlnuum from 1 (The term has.no meaning to me) ' to 5 (I have studied the topid ^ 
In depth and/or have had much contact through observation or practice). It 
wa§ hypothesized that posttest results -of selected items under)~study would 

.differ significantly from pretest scores. The statistical ^procedu^rfe used to 
analyze thes,e data is the t'-test for dependent"* samples with a matched pairs 

^ — ■ 
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destgn XBlalock, 1972). In this design the same individuals are compared^ 

before a'nd'after an experimental variable has , been introduced. Thus,_this 

design analyzed a pair of scores for each pert ici pant as a ^hfeck of gr^up" 

differences of self-ratings. The experimental variable in'this case was 
% 

the competency-based .staff development workshop.' 

» 

'Remits of the pre- and posttest administration of the self-ratios of 
curriculum concej^s are .d i splayed in Table 3. Pret-est means indicate the 



^ Table 3 
Mean-^Scoresa 'and t Values' for Participant's' 
Self-Ratings of Curricular Concepts 



'Curriculum" 


Pretest 


Posttest 


t ■ 


Level of 


Concept 




X 


Value 


Signi f icance 


Domains of Behavior 


4.00 


k.kj 


-3.3^ 


.01 


.Flowcharting 


' 3.^ 




-5.66 ' 


: 00 1 " 


1 nstructional Objectives 


4.42 • 


- 4.63 


-2.20 


.05 


-^A Learn i,ng System Model 


3.21 ■ 




-5.62 


.001 


-Cr 1 te r i on- Referenced 










Measurement 


3.68 


3.84 


-0.83 


HS "I ■ 


Competency-Based Education 


3.68 


4.26 


-3.64 


.01 



^Possible response range was 1-5. 




r 



participants had either a general idea or some specific (^^^^^ge and/or 
experience with the s\){ curriculum concepts analyzed. They" were most con- 
fident about instructional objectives and domains, of behavior, The hypothesis 
that posttest means would differ' significantly from the pretest means was 
supported for five' of the. six workshop topicSti^ Significant differences were 



24 



ERLC 



..attained" for the topics of domains of behavior, flowcharting, instructional 

objectives, a, learning system m<^del , and competency-based educa^sion. ^"^Only 

the topic of criterion-referenced measurement failed to reg^s'tetx*a- signi f icant 

di.fference. , * » - . 

Assessment of participant af ti tudes**towards the workshop, its instfuc- 

. tional strategy ,' the learning system model, and the co-leaders were elicited 
■ _" " • 
from two opinionnai res administered at the conclusion of the workshop. First, 

the Post Workshop' Evaluation (POWE) instrument obtained paft i ci pants * att i tudes 

abogt: (aj the yvorkshop enabling objectives, .(b) the workshop learni'ng acriv- 

iti^es, (c) the workshop co-leaders, (d) the evaluation and feedback techniques, 

and (e), open reactions. Second, attitudes toward competency-based education, \ 

th6 lear-rting sy^t^fti model, and the total staff devel-opment worksfiop' were ob- 

tained .through the administration of Remmers* Scale for Measuring Attitudes 

Toward Any^ Practice. ' ' ^ 

Responses to Parts I and IK of the POWE are presented in Table 4, Here 

it is shown that the participants held favorable attitudes toward the workshop 

enabling objectives. All participants either s'^rongly agreed or agreed the 

objectives helped them recognize what perf^ormances they accomplished and 

^ also prescri bed "standards whi^h" helped them self-evaluate their performances.* 

^ Almost 35% strongly agreed or agreed the workshop objectives were relevant > 

models in their objective writing efforts and nearly' felt the objectives 

\ 

* helped them recognize specifically how well they completed the expected 
performances. About SO^felt the 9bjectives were structured so they' cou-ld 
self -pace th^'if learning throughout the week. 

Table k discloses the participants holding favorable attitudes toward 
the workshop learns ng activi tie? . All participants eTther strongly agreed 
or agreed that^.lndivjdual conferences with the co-leader^s .helped learning 

- 25 ■ ■ . 
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'table 

Participants' At t i tuSes Toward the Workshop* Enabl i ng Objective^ 
^y'^nd the Workshop Learning Ac^ivittes-^ 



" ' Percent^ > Percent 
* Strongly Perpef»t Percent Strongly 
Evaluation Item Ag ree res' 0 i sag ree Pi sag ree 

The workshop 'enabl ing objectives: ^ " , 

). helped me to recognize spec- 

, ifically what performance I , . 

, did during the workshop 57.9 ,^2.1 0 ^ . 0 . 

2'. helped me to recognize spec- * ^ ' 

^ , if ixal ly ,how wel 1 I completed 

. the expected peVformances. ^7-^ - ^2,1 10.5 ^ 0 

^ 3-" prescribefi standjsrds which, - ^ . » ' ^ 

^ \ helped me to sel f-eval uatB ] ^ * " ■ . 

-C^ iyiy performance's ^ "^2^1 57-9 . P ,0 

k. wer6 sti:ucfUred so tl^at I ' , . - * 

•<i could se 1 f --pace ^Tiy learning * ^ ' 

' \' throtighout the week 26,3 •52.6- ;\21.1 0 

5. were relevant in tej-ms of ' > . » 
providing me with a mddel " ' ' . 
to follow i.n my objective . ^ ^ * 
writing efforts 36.8 57-9 5.3 

ThjB workshop learni^ng activities: 

6. were tiel pful to meaningful - , , ^ 

learning ^ ^ 31.6 ^ 57-9 ,15.8 0 

- 7. were varied enough to syit , • 

m/ ' 26.3 57".9 15.8' # ^ ° 

8. afforded me options to ' ^ 

master^'her workshop , " ' > 

object I VBS - 44.4 38.^ ll-l , * 0 • 

9. helped me^ to learn In in- 
dividual conferences with — ---- 



lthB-wa|-kshpp' co-leaders ^3.2^ 36.ff 0 

63.^ ^ 31.6 ' 5.3 0 



V 10. helped me^-fco ji^arn from my s * 

peersMn small groups or , ^ . , 



in one to one sessions 



ERiC ' 



/ . ^Pefcentages were computed excluding the omits; only one omit was 
observed for these items. * , ^ 



while'nearly SS% held the same opinions about small group or one-to-one 
^ ^§esslons with their peers. About 90^ of the participants strongly agreed 
or agreed the workshop learning activities afforded them options to master 
the workshop objectives. In only a few cases did a workshop participant 
disagree with any of the positively stated attltudinal items ind only rn 
one case did a participant strongly ^^di^agree with an item in Table 4. 

«Tab1e 5 d i Sfil^^ys jjart ici pafits * ratings of the workshop evaluation and 
feedback techniques. Participants' possible ratings ranged from a high'^of 

4'' ' Table 5 

Participants' Ratings^ of Evaluation and Feedback Techniques 

^valuation and/or 
Feedback Technique 

/T^^retest' 

erformance Record 

^ ' ... 
" ^Sample Learning 
L- S ystem Evaluation 
^^^''cksheet 

Oral Feedback * ' 

Written Feedback 

^^Reported as percentages of those respfonding excluding the omits;, 
only on^ omit was observed ^for these items 4- 

5 (very important) to a low of -f (un impcj^rtant) . The majority olF the partly 
Ipants felt each of five evaluation and fi^edback techniques were either 
highly Important or very important. Nearly 7^% of the group felt oral feed 

i 

back^Was hi^l^ important or very important while 67% of the participants 
-feit the same way abodt the >written feedback-. The other three evaluation 



Highly 
1 mpor- 
tant 


Very 
Impor- 
tant 


Impor- 
tant" 


Not Too 
Impor- 
tant , 


Un im- 
por- . 
tant 


21J 


klA 


15.8 ■ 


10.5 


10.5 


36.8 


26.3 


21 .1 


0 


15.8 



klA 


15 


8 


15 


8 


5.3 


5.3 


57.9 


15 


.8 


. 15 


8 


5.3 


5.3- 


33.3 


33 


.3 


27 


'8 




0 



and feedback techniques of pretest, the performance record, and the sample 
learning system evaluation checklist were all rated either highly important 
or very Important by 58% to 63% of the participants. A few individuals felt 
each ot five evaluation and feedback techniques were unimportant* 

Workshop participants* ratings of the co-leaders' Instructional, efforts* 
are shown in Table 6. The possible ratings ranged from a high of 5 (highly 

Table 6 ■ ^ 
Participants' Ratings^ of Workshop Co-leaders 

V 



Workshop Co-leaders' 
Ins truct ional Pract ice 



highly 
Effec- 
^ t Ive 



Very 
^fec- 
t ive 



Effec- 
tive 



Hardly 
Effec- 
tive 



I nef fee- 
tive 



Presentation of materials,. 

and information Tn full 

grpup settings 15,8 26,3 

Instruction in small 

group settings 33.3 ^"*^.3 

Instr-uction jn Individual 

conferences' 31.6 

Overall helpfulness and 
att i tude in.^td Ing you 

to solve problems * 52,6 26,3' 

Organization of learning 
materials and learning 

activities ^ 31.6 klA 



36,8 15.8 



27.8 /4v-M' 



5.3 




15.8 



1.5 



^Reported as perce.ntages of those responding excluding the omits; 
only one omit' was observed for these items, . * - 

effective) to a low^of 1 (ineffective). All participants rated the co- 
leaders as highly effective or very effective at instruction in Individual 
conferences. Nearly &€% of the participants felt the co-leaders were highly 
or very effective in their -overal 1 helpfulness and attitudes In. aiding to 
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solve prob1§m|*'whi 1 e nearly 7^^ held simi lar. opinions regarding^ t-he co- 
leaders^ prganization of learning -materials and learning activities. Twq- ' 
thirds of the group felt the co-leaders were highly effective or very 
effective in small group settings. Less than half the group (42.1^) felt 
the co-leaders w^re highly effective or--very effective In the presentation 
of materials and 'information In full group sessions while 2-1.1^ rated the 
co-leaders as. hardly effective or ineffective at this specific instructional 
mode. . - ' , ^ 

Finally, the fifth part of the POWE Instrument elicited participants' # 
open reactions to the workshop, A total of 25 open comments were volunteered 
by the group; these comments were coded as being positive, negative, or 
neutral. Sixteen positive comments, six negati ve^comments , and three neutral 
"comments were offered by the participants* r^Fol lowing Is a sample of . the 
positive open comments from the pa rt idi paats : 

"A workshop should be for wgrkiji^ . . \ th I s one was." ' 
"This workshop has given us a common, tool for communication." 

"With the exception of a few instances,' the workshop was a 
v' fantastic experience for- me. The interaction v^^^n working - 

^^ ' Individually [with a co-leader] was beneficial. I feel 
^ ^ . '/more competent to attempt tasks which are my responsibility," 

;v'"lt seems to me th^t I did rather wel l--lgrew. '" 

'The woj*kshop was very helpful and I am eager to get on 
t.Ith Implementing the systems approach In my own area of 
responsibility." ' ' , 

* 

"I really liked the way we were allowed to progress through 
- the system and deal with our individual needs. It was a 
'•^'good example of CBE.". \ * . ^ 

"I reaJly liked the way individual Izatlpn was conducted with 
the learner." 

.'"I really liked the way CQ-leaders and colleagues helped 
out^wlth problems." * — — r- 




\ ^ , ^ *M really liked the way the materlaJs and leaders were well, 
prepared.^* ' * 

Pa^rt Iclpants* attitudes toward the workshop *wer'e al3o obtained and 

' * 1 

•analyzed by Remmfers* Scale for Measuring Attitudes Toward Any 'Practice. ^ ' 
Kemmel-s* Scale yielded the degree to which the group liked or disliked the . 
practices of: (a) competency-based education, (b) the learning system model , 
and ,(c) the staff development workshop. Remmers states that 6.0 Is the 
dividing point betwe,en favorable and unfavorable attitudes; mean scores 
above 6.0 denote favorable attitudes while mean scores below that fl.gu.re 
denote unfavorable atlTltudes. Table 7 displays the results of the adniln-! 

. ' . "TaBle 7 

Mean Scores^' for Participants' Attitudes Toward Workshop Topics 







Me^n 


Standard 


Topic 


N 


Score 


Deviation 


tompetency-Based Education 


19 


8.3^ 


■ 0.91 


The Learning System Model 


19 - 


8.31 


0.89 


This Staff Development Workshop 


19 


7.95 


' 1.16 



^Source: Remmers* Scale for Measuring Attitudes Toward Any Practice , 
copyright, Purdue Research Foundation, I960. 

fstratlon of Remmers* Scale. The resultant dita display shows' the participants 
hel;d 'favorable attitudes towards all three topics. Also, "the participants 
,gaye very simi lar mean scores to the three workshop practices. 



, CONCLUSIONS , _ 

A major conclusion based upon the findings presented in this document 
J IS that an Intensive,, competency-based, mastery learning*workshop^.can-.be an 

effective diffusion strategy for statewide curriculum leaders to develop 
learning systems. Workshop participants mastered more than 98^ o^their 
workshop enabling objectives. 'Significant pre-posttest di/ferences on 
part KTtpants* self-rating of competence wi th five^ef six worjkshdp curriculum 
concepts were noted. ' Participants held favorable attitudes toward the work- 
shop enabling objectives, workshop learning activities^ and the evaluation 
and/feedback techniques. Further, the majority of the group rated the wjir-k- 
shop co-leaders as highly effective or very effective on four of five in- 
^tructional tactics. Many favorable comments were volunteered by the — 



participants. In "srdiaTt i on , "attl uTdes of the participants toward three 
workshop practices were rated favorably- by a separate evaluation instrument. 

A second conclusion based^upon^ an analysTs of participants' responses :^ 
to attitudinal items and their open comments is that the use of explicitly , 
stated instructional, objectives combined with individual conferencing with 
participants seems to be the most appreciated instructional tactic by 
these statewide curriculum leaders, Onei^hondred percent of the participants 
strongly agreed or agreed that the use of specific workshop objectives helped 
them recognize ejcactly what they did and also provided standards which helped 
them self-evaluate their performances. Also, 100^ of the participants agreed 
the individual conferences with workshop co-leaders helped theic^ learning 
and they rated the co-leaders as most effective at this instruct ional „tactjcj.__ 
Oral feedback was rated as the most important evaluation and feedback techniqi/e 
during the workshop. 
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A final conclusion based on the overall data composite Is that the 
statewide curriculum leaders in this workshop possess the cpmpetehcies and 
attunes representative of a proactive state department. 1 eadership role. 
AIJ that remains to be seen is the actual diffusion of the learaing system 
model In their divisional function's and projected activities. ^ 

„ „.:REGi)MMENDATlQNS 1 L . - 



Based on the experiences of the innovation diffusion strategy described 
herein, the following recommendations are made: 



1. The elements of the learning systems model operational ized in 
this workshop should be utilized by the statewide curriculum 

'leaders as a diffusion strategy. * ' 

¥ f, 

2. ^ Follow-up data j|ioul d bB collected relative to the participants 

on-the-job behaviors regarding the Implementations of the In- 
novative learning systerrlNtjodel • " - 
The use-uif^he competency-basM'^s^rkshops should be consldjered 
seriously by other State Department or^E<lucat Ion bureaus and 

V ^^^^^ * •* 

divisions adopting innovations fpr their staff>\Data should 
be collected to assess their effectiveness. 
k,^ The use of full group or small group follow-up sessions for 
those s'taff members requesting or requiring aid in the 
impfementation of the learning system model Should be con- 
sidered by the Director of the Division of Instructional 
Learning Systems. ' ^ ^ 
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EXHIBIT A 



WST VIRGIN^ DEPARTMENT OF EDUCATION 
BUREAU OF LEARNING. SYSTEMS 
DI^ISIOirO*=^ INSTRUCTIONAL LEARNING" S7STEMS 



WORKSHOP TERMINAL OBJECTIVES (TO) AND ENABLI^^g'oBJECTI VES (EG) 



Each .workshop participant will accept learning system design as a 
viable^ educational alternative, - • 



EO^ Provided an opportunity in small and large^'group activities ' 
dealing with value systems, each workshop participant wi 1 V 
» share his/her personal beliefs about learning systems by 

completing the activity as directed by the workshop leaders, ' 

EO2 Given large group, small group, and individual instruction on 
the learning system model , shown a relevant example learning 
system, and given a standardized format for an example' learning 
systerp model, each workshop participant will clemoxist rcite com^ ' 
petency in learning system design by preparing an original 
e){amp1e learning system that: (1) contains, as a minimum, all 
the components listed in the standard format, and (2^ is suit- 
for implementation within your divisional Vesponsibi 1 iti^^. 




Eac.^ workshop particijDant wiTl share his/her expertise and Assist 
fc^l leagues in achi'evi^g the workshop objectives^ ^' 



EO 



3 



During the workshop week devoted to developing l^earning systems, 
each woFlcs'hop'participant will, at least once, share his/her 
ejy^ertilse about a topic under di scuss ion ' by ^the whole group. 



EOi| During the workshop week devoted to developing learning systems 
each workshop participant will voluntarily assist at least^one 
colleague in achieving hls/he»r workshop objectives, * 

Each workshop participant will recognize and/or match his/her in- 
structional values with the characteristics of Competency-Based 9 
Educatiojri, , • ^ ' 



EOj During a vajues inventory .activity or in conference with, the 
^workshop leaders, each workshop participant will recognize 
and/or maitch his/her instructional val^ues with the character- 
'istics of Competency-Based Education. Mas^tery of this objec- 
tive will be attained when the participant matches .a minimum 
pf four self-perceived values with four characteristics of 

, CBE ^s presented, * ^ ^ ^ 



EO 



Workshop Objectives - 2 . ^ 



Each workshop particjpant will write instru/:tional object ives 
fVectIng the domains and levels of learning.- f . 



|EOg Given an unordered list of cognitive, affective, and psycho- 
motor instructional objectives,' each workshop participant will 
categorize via multiple choice select ions^ the objectives into 
the cognitive, affective, and psychomotor domains of behavior - 
according to the criteria established by Bloom, Krathwdh 1^ and ^ ' 
Simpson. / Mastery e^als 9 out of ten instructionaJ objectives/ 
categorized correctly.' .* • ' ^ * 

EOy Given a list of cognitive, af feet ive and psychomotor instruc- " 
'tional objectives, e^ch workshop participant will categorize 
the levels within domains of learning of the^objecti ves.. " 
Mastery will b,e attained when the participant can identify- 
instructional objectives for any two levels for each domain of 
learning according to criteria established by Bloom, Krathwohl , 
and Simpson. . , , ^ - 

, EOg Given ajist of instructional objectives written for the three 

domains of learning, each workshop participant will discriminate 
the elements Jf terminal objectives and enabling objectives by 
identifying the following five elements successfully of the, 
time: (1) learner term, (2) performance, (3) content term, 
[S) conditions, and (5) criterion*. ■ . . 

EOg As a result of the achieving the competency lev^l for the ore- 
ceding two instructional ^objectives and part hci pat ing in^vSjfk- 
shop learning alternatives, each workshop participant wi 1 1 
demonstrate competency in v^riting Te^inal^Objectiyes a|\d 
Enabling Objectivj^s J^y preparing one. original TO apd one 
original EO for^each of the domains Qf learni-ng.^ Each TO wj 1 1 ' 
contain a learner term, a performance term, and a statement of 
content while each EO will contain the aforementioned plus a 
statement of conditions, and the criterion,. .Additionally, 
each TO will be related to each EO by each EO being written at" 
.least one level less in its domain according to criteria estab- 
lished by Bloom, Krathwohl*, and Simpspn., Mastery of this objec-^ 
, tive is 5 out of 6 objfectives.^ 

jEac|! workshop participant will analyz^ and evaluate -the components of 
thei learning system model as p-resented. , 1 . 




EOjQ Given instruction on education terminology, erach 
ticipant* Wi 1 } tief ine the term model as it pertairtj 
theory orally or^xti writing by defining i t ,wi't;h';^^^^.^_ .^^^ 
sentences, containing the essence of the term pr^^^ i ff^'Pentiat i^ng 
it from two other related, but different, ter'ms.'^ 

EO^I Given a blank sheet of paper, e^ch workshop participant will 
identify the elements of the' Type II- learning, system model -by 
drawing and labeling the model as presented. 



'Workshop Object ivesv" 3 



'E0j2 Following various ' learning atternatives pertaining to the 
• element§„ of<thd Jype II learning system model, each workshop 
^ participant Y^jM ora.lly or in writing explain each element ^ 
with a winin^gfi^^ oae- sentence >^ach. 

E0]2^ol lowing va^flous learning al ternativfes pertaining to the 

elements of^the TypeH I- learning system model, each workshop 
participant will cfrally or in writing explain the relationships/—^ 
, interactions of elements of the model. Mastery level for the 
\ objective i s *a minimum of four elefnents selected by the work- 
shop leader explained with minimum- of one sentence each. 

^EG]/| After writing iSn original example learning system, each par- 

^ ticipant will evaluate his/her work "by completing an instructoT^ 
prepared evaluation checklist without: leaving any blanks and 
which is 90^ agreement with a workshop leader's evaluation. 



Each workshop partipVpant will design an original example learning 
system'appTbpriate to his/i^fer divisional responsibi 1 i tijes. 



E0|5 Following instruction and provided 'examples^ each workshop 'par- 
. * ticipant^ wi 1 1 draw and identify a minimum of three flowchar^ 
.symbols as presented during the instruction. 

& y 

EO^^ Fo-I lowing instruction and after identifying three flowchart 
symbols, each workshop participant will explain the three 
symbols either orally or in writing with a minimum of one 
sentence each with characteristics congruent with the 
instruction. -1. — 

EO|y Following instruction and aft^er completJng the above two objec- 
tives, each workshop) participant wi 1 1 ^flowchart his/her learning 
system activities. Successful mastery will be attained when: — 
(1) a minimum of two entry/exit points are identified and,^ 
symbolized, (2) a -minimum of five process^ a5;JtJryi„ties are ideri- 
• tified and symbolized, and (3) a minimum of two decision p.oints 
are identified and symbolized and two alternative leaders are 
drawn. 

EO]g After preparing original enabling objectives (one for each 
domain of learning), eath workshop participant will select a 
minimum of two leafning act i vi t les *for his/her example learning 
system which are congruent withthe previously prepared ^ ' 
object Ives . ' 

^O^q After writing original ena'bllrig objec'tlves ancf selecting con- 
>gruent learning activities, for , his/her example learning system, 
each workshop participant will .write criterion Item^ for their 
example learning system preassessment , seK^'assessment , and 
post-assessment deVices/'whIch are congruent^wi th the preyipusly 
prepared objectives acQordlng to the Mager objective item*';, 
checklist. . ' ^ '>W^j4.. . fi^ ' 



Workshop Objectives - 



GWen\^ernative ^earning activities ^nd relevant* resources 
during the workshop' week, each workshop participant will 
write an, original example- lea rnjng, appro(:>r late to his/her 
livlslonal responsibilities. Su'cces'sf u1 completion of this 
a<stlvlty wIJI be attained w^hen the example learning system 
coWalns a rationale, learn jng objectives, a prtassessm^t 
de>Mce, decl'sjon pomts, le.ar.ning activities, and media/ 
resoiirces, a self-assessment device, and a post-assessment 
deviXe according to^e criteria estabi ished^-ln* the. 
•''Components of the Lerarning System," 
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RATIONALE 



There has been ..a wide range of discussion about Competency-Based 
Education (CB£)-with strong voices rising to be counted for the nays and 
ayes. tCompetency-based education may -be compared to the parable of the 
three t>l^nd men who, while walking in the woods, came upon an elephant. 
The first blind man, who only felt the trunk of the elephant, thought he 
was feeling a snake. The second blind man, who only felt thfe ear of the 
elephant, thought he had found an unusual plant and the third bjind man, 
who felt the stomach of the elephant, knew he found a whale. Likewise, 
CBE is many things to many people. Some people see it as behavioral 
objectives, others see it as individualized modules, and still others 
see it as flowcharting. In realfty, it is all of those things and more. 

The purpose of this workshop learning system is to share with you 
several elements ot CBE, We hope the end result will produce a clea,i-er 
picture of CBE and more importantly improve the teaching/learning proces 
In the State of West Virginia, 
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WEST VIRG^^NIA DEPARTMENT OF EDUCATION 
BUREAU OF LEARNING SYSTEMS 
DIVISION OF INSTRUCTIONAL LEARN I N<3 'SYSTEMS 

I .L.S. ' STAFF DEVELOPMENT WORKSHOP OBJECTIVES 

1. Accept learning system design as a viable educational alternative. 

2. 'Share expertise 9hd assi*st colleagues in pi^'ieving the workshop 

object ives . -^1 ^ - 

3. Recognize and/or match your instructional values with the character- • 
i sties of Competency-Based Education. ' — 

Write instructional objectives reflecting the domains and levels of 
learnin'^. 

5. Analyze and evaluate the components of the learning system model 
presented in the workshop. 

6. DesigrT^ original example^ learning system appropriate for your 
divisional responsibilities. , . 



/ 
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WEST VIRGINIA DEPARTMENT OF EDUCATION 

-BUREAU OF LEARN IN&--SY-ST-EMS 

DIVISION OF INSTRUCTIONAL LEARNING SYSTEMS 

INSTRUCTIONAL BELIEF SYSTEM 



All of us have some value system which ^serves as a guide 'for what we 
eventually do. Within that value orientation-; we educators have a .sub- 
system related to our personal beliefs about education in the schools. 
T^osd values we boid regarding education provide a frame of reference for 
our personal professional goafs. In addition, we tend to select profes- 
sional* activities related to our value system. 



The issue then is, "How is one's value system related to education in 
general like, or difiperent from, the characteristics related to Competency- 
Based Education (CBE)?" We maintain thatMf educational leaders were to' 
Specify their personal 'V^l ues and assumpt ions about education, they would 
find significant similarity between those personal values and the charac- 
teristics found in CBE.- /<> - 

The learning outcomes anticipated In this activity rests solely upon 
the accurate identification of your personal value system and the open 
Interaction with your colleagues and workshop consultants. Within these 
'•simple guidelines,' the broad goals suggest that you will: \ 

1. Understand the values that are at play in your personal 
bel ief system. 

^2. Compare your values with the values and assumptions 
related'to Competency-Based Education. 

3. Accept the fact th£t though thene are *some differences, 
these differences are rrot insurmountable. 
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V ALUER IN THE CLASSROOM* 



STEP - 1 



us wa^ys in a 
I? ^lace a 1 



Below are twenty-two' values that might be displayed in V: 
classroom. In your {deal classroom ^which are your top 
next to the quality you value most fn your classroom, a/5 next to the 
second most important, and a 3 next to the third most important.-^* 



freedom 

.Rigidity 
Self-d i rectioh 
Personal Choice 
Quiet 
Chaos 
Laughter 
Passivity 
Decision Makin 
Fear 
Purposef^ulness 



Dogmatism 
Orderliness 
Favor i tism 
Creat ivi ty 
Al ienat ion 
Mutual Respect 
Privacy 
Equal i ty 
Domi nance 
Fai rness 
Love 



STEP - 2: 



,Now take a feft marker and list, in ordi&r, the three values you chose on a 
3x5 card so that the words can be seen by others. ^ 



STEP - 3 : 

^Walk around the room until yoQ meet with other Educational Leaders dis- 
playing the same or nearly thp same,*values as you have indicated on your 
3x5 card. Cluster into small groups of 4-5 Educational Leaders. 



STEP - k : 

Discuss the values identified by your group and m^tctii' ^^tiecn w th^^^' cha'r-; 
acterlstics related to Competency-Based Education. 



WrI te"OTr"your' groups findrngs-'amf^sfere them with the t&tal '^fUup. 



^Source: Discovering Your Teaching Self , by Richard L. Curwin 
and Barbara Schneider Fuhrmann. Englewood CJi'ffs, J.: Prentice-Hall, 
1974. 
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CHARACTERISTICS*OF COMPETENCY-BASED EDUCATION* 



1. The jnaln indicator of student achievement is ability^ yD d£ the job 
effect ively sand efficiently. 



2. Learnings (competencies) are presented in small I'earning units or 
modules, combinations of which are -des-t-gned—to- -helj>- students apsydlre 
full competence. . 

3. Entrance requirements- are not of paramount concern.. Students start 
where they are. I f, they are not ready , ih^y are^nelped to become 
ready. 



4. Provision is made for diffe^renMS among students in their styles of 
learnihg by providing them withWarious alternate paths for acquiring 
competence. ' 

5. Instruction is individualized/personalized and systematically planned 
for as an integral part of the* e'ducat i on program. 

6. The learning experience of the Individual is guided ty continuous 
evaluation and feedback. 



7. The learner is held accountable for performance. 

i J 

8. Instructors are held accountable for the ej<tent to which students 
^§cquire the desired competencies within the limits dictated by their 

W\ 1 i ties. * ^ • 

' 4 

9. . Public sharing of .the objectives, criteria, means of assessment, and^ 

alternative activities. 



^Source: Johnson , Charles'E. Journal of Teacher Education , 197^, 
p. 355-356. ^ ^ 
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COMPONENTS OF THE LEARNING SYSTEM 



Described below are component? of a learning system. Some questions 
are 'included to help you prepare these componerlfs of your learn I ng s.y stem. 

I. CONCEPT ; An abstract idea generalized from specifics - a title. 
'*What Is the m^in theme of the system?" 

IJ. RATIONALE ; This Is an Indication to the learner as to why the » 
system/package Is to be completed. In'other words, It Is a 
justification for Involving a learner * s-ef forts wUh a particular 
concept, skill, or 'attitude. It Is a good idea to communicate to 
the learner how^thjs system-delates to the total. scop^JooiL sequence 
of your InstructTon*. ~ 




ill. . LEARNING OBJECTIVES ; Behavioral ly stated expected learrteWteutcQmes . 

'**'SpeGif leal ly, what will be'l^xpqcted of the learner when he haS' 

comt^leted this system/package?" These objectives will cor^taln 
• - statements 6f th6 corrdl tlpns under which the objectives will be 

performed, a descrlp-tlon-of— ti$€--observable perfo rmance that will 
accepted as evidence that learning has, taken place, and a Irstlng 

of the criteria or standards that will be used as the basis for 



evaluation. Any choice bf reputable objective writing formats and 
'termtnology are acceptable. OtRer narneTTo^r"Orr¥ LS^componeVt' 
could be: behavloYal objectives, instruct lonal^ object Ives, enabling 
objectives, performanqe'-objectl ves . Thjs will depend upon the source 
you use for objective writing format 



IV. PRE-ASSESSMENT : A pre-evaluatlon which Identifies, '^hat does tlje 
learner know about the concept, etc. before beginning?*' Sometimes- 



called a PRETEST. 



POINT OF DECISION ; /A commltrnent Is necessary at this f^otnt. The 
learner must choose th^ paTp'^apprrOpr I ate to his/her knowledge of ^the 
subject and most successful, mode of learning. ^ He/she roust answer, 
at varJous times, the following questions: 1) *'Whlch activi ty or 



form of media Is the most appropria te m eans fo r me ^ to ac h ieve the" 
objectives of this system/package, 2) should I go on to the post- 
assessment or go back and try a different type of activity, and 
3) are there add I tion^l espects of this concept wflch ' Tmlght , 
'further pursue?*' This /Is a point between spelflf Ic aspects of the 
system/package and usually occurs as directions or Instructions. /| 



L 



^mpojients of the Learning System ^ 



IN jTRU CT I ON/LEARN I NG ACT I V I Y I ES ; Diversified learning activities ^ 
•and multimedia utilized to master the objective of the system/ 

package, '^hat means are av.ailable so that the^ learner may master 
^the objectives af"thfs system/package?" Accommodations for different 

learning styles should be provided for in this component. 



SELF-EVALUATI OH : Self-assessment of progress toward achieving the 
objectiv es and answers the learner's qqestlon, ^'Howwell have f 



mastered the objectives?" Sometimes called a SELF-TEST. 



DEC IS ION ; SimHar to component number V described above. 



w 



EVALUATION ; Thfs .post-assessment determines if the learrier has 
successfully mastered the object ives of the system/pacl<age. "Can 
he now do what the objectfve (and Incidental ly the instructor) 
expected of him?," Usually adrfjnistered by the instructor an^ 
affords an excellent tiine to arVarjge for individual conferences. 
Sometimes called^a PO'STtTEST or- MASTE^TEST. 



FEEDBACK : This component of th^ *syst'em provides Information to the 
originator bf the system/package/, ^d the learner also, regarding 
the reliability and validity of^the learn Ing^dbject ives component. 
Feedback may' also provide vafuable Infbrniation. ccyicerning other • 
components of the systemj^fSSackage. '.^ ^ 
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• r. THE ALPHABET: 



A LEARNING SYSTEM 




THE ALPHABET 



Concept ; The alphabet 



II. Rationale : The alphabet Is one. of the basic s^eps to 

learning. The student must learn the 
alphabet before learning to read or write. 
Tell the children that th;is package wi 
show the importance, of the alphabet and 
preseht various methods in learni^ng their 
alphabet. 




I 1 1 . Terminal Objective ; The student will be able to recognize, 

recite, and write the alphabet. ♦ 

IV. Enabling Objectives ; Given the letters of the alphabet, the 
/ - / student will bd able to recognize and tell 

^ wha,t each letter is with an dccur^cy of 

^ ^ , * recognizing 23 out of 26 Jetters correctly. 

Given the al phabet ^oral ly , the student will ^. 
" * > be able to repeat t/ie alphabet orally* and 

in sequence getting 22 out of 56 'correct. 

Given^the letters pf the alphabet; the 
student ^11 be able to reproduce, the 
letters Tn writing making 23 out of 26 
Correctly. ✓ 

Gftven the 'capital and small lett^^ of the^ 
^ alphabet, the student will be able to match 
corresponding letters getting 2k ©Lit of 26 
^ correct. ^ ' ' 

Given the letters of the alphabet and 
. pictures, the student will be able- to match 
the letters to the beginning Is^er^of the 
pictures wi th 35% accuracy. 

Pre-assessment : . The teacher will ask the children to; ^% v» 

r- I • ■ .V ■ ■:• 

1. Show recognition of capital and sm^ll 
letters by orally telling the teacher ^ 
s the name of each letter. ' ' 



^ 



2. Write the capital ajid ^mall letters. 

3. Match capital and small letters. } ^ 
H. Wri.te their own name. • 
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'The\'Alphabet 



Point-of -decis-ton^ 



The teacher will tell the children: 

1. They may ^go f^the self-test if they 
feel they can successfully achieve the 
objective of this package. 



or 



If students do not feel confident In * 
their knowledge of the alphabet > tsbpfi - 
they may go to learning activi€fes, and 
'ttt^ri'^'O'^'serTf^^s^t and post-test . The 
children Hnay choosy the .activiti,es tljgy 
feel they neednta succe>5'fDliy complfete 
the object liv^ gf the papkage.';. , ' ^ 



I nst ruction/ learning 
activities: 



0' 



A. View tape and slide series bf; li • The' alphabet 

-'"""^^^ . 2. Alphabe^ rhyme 

B'* Flannel Board: ^ 1. Feel snape^of letters 

• * 2. Recognitions of capital letters 

/ ' 3. l\ecogh}ti;on of small Hitters; 

^ ^ ^ k,* Sequ6nce .of letters 

5. Match lettfers ^ . - 



C. 'Charts/Transparencies: }. Follow steps- In making letters- 
^ ' ^^ ^Z~* — Practice 'mfakipg letters ^ 
' .'3*, Follow dots. In sequence of letters' 

^ ' form piqtu-pes. 

- , ' ' ^^."^ Color pIdturjBS using colorjfletter * 

, ' • ^ ' ; matching. 

5. Writ^ beginning sounds for pictures 

' •■ . ^ ^ ^ - ^ -1 ^ ^ ^ * •• " I 

Book - Preschool Jjelper Alphabet:. , \ ^ 

1. * Practixe making letters . ^ * 

Association AofMetter with picture.* » - • 
'3* Use lined paper to supplement In practicing the writing 
of the ajphabet . ' > ' , • . ' • 



E.' Picture/Letter Blocks: 



Associate pictures wi th ^-letters 
using large '^blocks," 

2. 'Use large '^blqcks" In. practicing 
' sequential^ order* ^ 

3. Use small '^'blocks*' to match letter/ 
' to picture. ^ v r 

k. Writ? beginn Ing letter on small 
, pi.cture ^'blocks*" 
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F. Plastif* letters: 



2. 

3. 
4. 



5. Use picture-book ^or checking, 
matching, 'and sequence.^ 

6. Use any of the picture '^'blocks" 
for picture, letter, and wor.d 
association. 

Recognition of capital lette^s* 
Shape of letters^ 

Sequence letters. - - ' 

Form words* 



,1^ 



.G. ^Flash cards: 



1. Use to show sequence 

2. Usenn matching capital and smal 1, 1 etters 
(self-checking) 



H» View Master Picture Presentation: 

1. View picture series for picture, letter, and word association, 
(2. ilse rhyme and coloring book for picture, letter, word 
^s^ociat ion, and for further interest with a story. \ 



Self-evaluation: 



Point o^decision: 



Evaluation 



The teacher will tell the chi'ldren to check 
their knowledge by using^the self-checking 
activities. 



The teacher ,tel 1 s the students: You decrde 
if you are ready, for final evaluation. ^ 



The teacher-wi 1 1 al'so checlC his/heT^own-Rrogress- 
by^vi^ewinjg ^he progress of the 5t»jdents.' 

The post-t,est will be the, same test given for 
the pre-test. < • 

lh% teadher Will stik tVie children' to: ' ' , 

1. Show recogQilion of capital and sma j 1 
letters by oral ly^ tel 1 ing the teacher 
'the name of ea€b letter . 
Wri:te the capital and sma I'f ' letters* ^ 
Matqh cipi'tal and small lettersT ^ 'S*- 

Write their dSn name.^ * 



1. 
3. 



Quests ; 



1 The student wilT listen to record and read the book: 
.Street ^- Lett^s . 



Sesame 



2; ' team to play card 'game with alphabet cards. 

3^. Use phonjc flash cards to show how^+^tters go together to form 
different sounds. 
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The Alphabet - k . 

Read books : ' / 

^' F'ind Your ABC's by Richard Scarry. 

b. Use ABC Words Dictionary to show letter, word, picture, 
and definitions. ^ . j , 

c. Ose ABC Book to Color to show many things ^that^ beg in wjth_- 
^ach letter. ' ^ ^ 

d. ABC Book by Dean Bryant for picture, letter, and word 
asspciation. x-^^^ 

e. ! The Sounds and Shapes of Letters provides many activities 

to do. ' , 

f™. — Anno-^s-Alphafaet by Thomas Y. CroweTl Company may be used for 
picture - letter association. 

g. Ride With Me Through A B C by Susan Bond and Horst Lemke for 
^^'^ story about letters. 

h. What Does A Begin With? by Nancy Dingman Watson and Aldren A 
Watson may be used for the story about letters. 

i. The Alphabet Book by P. D. Eastman may be used for picture, 
letter, and word association. (This book may also be used 
with the si ide series.) ^ ' 
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A SAMPLE LEARNING SYSTEM 
(You complete the ^blanks) 



The alphabet. 




II 



III 



iv; 



; The alphabet is one of the basic steps to le^r^ing. 

The student~must-4^rn- the alphabet -tefore—lt^arning-toTead or write. 
Tell the ^chi Idren that this package will show the importance of the 
alphabet and present various methods in learning their alphabet.. 

The student will be able to recognize, 



recite, and write the alphabet. 



ERIC • 



_ Given 'the letters of the alphabet , * the 
student will be abl-e to recognize and 
tell what each letter is with an accur'acy 
of recognizing 23 out of 26 letters 
correct ly. 

Given the alphabet orally, the student 
will be able to repeat the alphabet 
orally and in sequence getting 2Z out of 
26 correct. 

Given the letters of the alphabet, the 
jstudent will be able to reproduce the 
letters in writing making 23 out of 26 
correct ly. 

Given the capital and sjnaH letters of, 
the alphabet, the student will be able 
to match corresponding letters getting 
2^ out of 26 correct. 



Given t?ie letters of the alphabet and 

* pictures, the student will be able txl 

match the letters to the beginning 

letter of the pictures with SS% accuracy. 

The teacher wi^l 1 asK the children to: 



1 



2. 



Sh*bw recognition of capital and small 
letters by orally telling the teacher 
the name of each letter. 
Write the capital and smafl^etters . 
Match capltaT^^nd small fetters < 
•Write their own name. 




0 



/ 



Complete the Blanks - 2- 



The teacher wll 1^ tel 1 the chMdren: 

y 1. They^ may go to the self-test if they 

feel they can successfully achieve 
the objective of this package. 



Of 

2. If students do not feel confident in 
• their knowledge of the alphabet, then 
they may go to learning activities, 
and then to self-test and post-test. 
The children may choose the activities 
they feel they need to successfully 
complete the objectives of. the 
package. 



A. Viewf tape and slide series of: 1. The alphabet 

' ' 2i Al phabet rhyme - 

B. Flannel Board: 1. Feel shape of letters 

2. Recognjltion of capital letters 
' 3'. Recognition of small letters 

4. *- Sequence of letters 

5. Match letters 

C. Charts/Transparencies: 1. Follow steps^ in making letters^ 

^ 2. Practice making letters. 

Afe f:'— SN^Follow dots in sequence of letters 

. j • ^ to form pictures. ' ; • 

- i 4. Color pictures using color/letter 
i^Wv matching. ' 
, _ ^ , i^^^^^^^K'W'^J beginning sounds^ for picturest^ 

D. Book - Preschool Weiper; Alphabet: 

1 . Practice maki ng letters ♦ ^ ^ - 

2. Association ^of'^letteV, with picture. 

3. Use lined paper to supplement in practic^ing the writing 
of the alphabet. 



E. Picture/Letter Blocks :' 1 

2 

. 3 



Associate pictures with letters using 
large ^'blocks. ^ ' . 

Use* large "blocks^^ .in practicing 
s eq u en Wxhl'-'Oi^e^^T^^ 
Use small '^blocffs'* t^^atch letter 
to picture. ' _- . . 

Write beginning letter^on small 
picture '^blocks.** 
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Complete the Blanks - 3 . 



.5. Use picture book for checking, 

matching, and sequence. 
6. Use any of the picture ^'blocks"' for 
picture, letter, and word associat i on. 

F. .Plastic Letters: '1. Recdgn itiorT of capital letters- 

2. Shape of letters • , 

'3. Sequence letters 
' ^. Form words 

G. Flash Carcis: 1. Use to show sequence / 

2. Use in matching capital and small letters 
. (sel f-checking) - C . 

H. View Master Picture Presentation: 

♦ 

1. View picture series for picture, letter, and word association, 

2. 'Use rhyme and coloring boolc for picture, letter, word associa- 

tion, and for further interest wi.th a story. 

^ The teacher wi/11 tell the children to . 

] ] check their knowledge by using the self- 

checking activities.' ^ 



Th^ teacher will also check his/her'own ' 
progress by vi.ewing the progress of the 
students . 

The post'^test will be the same test given 
for the. pre-test. 

The teacher will ask the children to: 

1. Show recognition of capital and small 
letters by orally telling the teacher 
the name of each letter. 

2. Write the capital artd small letters. * 

3. Match capital and small letters. 
k. Write their own name. 



1. The student will listen to record and read the book: Sesame 
Street - Letter^.. — . 



Learn to J>lay card game wi th 'al phabet cards, 



3. Use phonic flash cards to show how letters go together to form 
different sounds. 



•Complete the Blanks - h 



ad books*: 



a. Find Your ABQ^s by Richard Scarry.* , 

b. Use ABC Words Dictionary to show \etter, word, picture, 
and def ini tions . ' . . 

c. Use ABC Book to Color to show many things that begin with 
each letter. . x ' 

d. ABC Book by .Dean Bryant for pictqre, letter, and word 
association. 

e. The Sounds and Shapes of Letters provides many activities 
to do. 

f. Anno' s A) phabet by Thomas Y. Crowell Company may be used , 
for picture - letter association., 

g. Ride With Me Through ABC by Susan Bond and Horst Lemke 
for story about letters. 

h. What Does A Begin With? by Nancy Dingman Watson and Aldren A 
Watson may be used for the story about letters. ^ ^ 

i. The Alphabet Bodk by P. D. ^Eastman may be used for picture, 
letter, and word assoclat ion, --{Jhi s book-may a]so be.usied 
with the slide series.) 
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A SAMPLE LEARNING SYSTEM 
(You Write Your Own) 



I Concept ; 



1 1 . Rationale: 



ML Terminal Object ive(s) 



■■ ■ 

f V, - . Enabl irtg Object Lves * 



V, Pr6*-assessnient : 



"ERLC 



m 



A Sample Learning System - 2 
VI . Point of Decision: 
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VII. I ns t ruct t on/Lea rn i ng Activities ; - ' - 



r 



VIII.' Self-Evaluation; 



IX. Point of Decision: 



X . Evaluatlonj 



ERIC 
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SAMPLE LEARNING SYSTEM EVALUATION 'CRITERIA . 



Name: ^ ■ Date Completed; 



\ 



I - Required I terns ; Read each of the fpl lowing statements. If you « 



PART 

demonstrated the behavior, encircle YES ; if not, encircle NO 
'The L.S. includes a: 

1. Jegib^e format ' \ ^ , YES' NO 

2. concept, skill, or attitude which a learner ' 

can master on his own YES NO 

3. minimum of (8) basic L.S,^ components ' YES NO 
A. logical sequence of L.S. components* YES NO 
COMPETENCY: YES^ for items 1-A. If not, RECYCLE. £ REVISE. ^ . 

PART II - Rating of Quality : Indicate the level to which each of the tasks 
have been performed by encircling the appropriate letter. 
C =*^ompetency £ R = Recycje* ^• 



R 



A. L.S. Components : To what extent do the components: 

5. r^lect a concept, skill, or attitude (Title) C R 

provide a meaningful justification (Rationale) C 

7. contain all components of the (Instructional 

Objectives) " C ' R 

8. measure prerequisite behavior (Pre-assessment) C R 

9. contain an adequatev, variety of (Instructional 

Activities) , C ,R 

10. ^diagnose learning via a (Self-Evaluation) C R 

/ ■■ ■ 

11. measure mastery of the instructional objectives 

(Evaluation) ' . ' C ' . R 

12. allow for decision-making throughout the L.^.*^ 
(Points of D^ecisrpn) 

66 ' ' , . ' 



► * Sample L.S. Evaluation Criteria - 2 



B. Evaluation Techniques ; To what extent: 

13. can you take your instructional objectives 
and criterion items completely through the 
nager flowchart assessment? ^ « * 

14. are the directiogs for the criterion items 
i:learly and precisely stated? 

/15- are the correct ^n^wers shown, available 

from the teacher, or, if appropriate, rating 
scales or checklists provided? 



Mastery of the COMPETENCY level for this learning experience wj 1 1 be 
evidenced by total agreement between you an'd the workshop consultant that 
you have achieved the competency rating on each of theXfems noted above, 

• .;/, . : 
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A model is a TSBncretization of a theory which is meant to b'e analogous to 
xor Representative of the processes and varTables involved in the theory. 
A-njodel is said to be correct or adequate by its abHity to produc'e the 
sameNjata as the object in the real world produces, from which the original 
^theory wa^s generated. Models^ may be of several type^'f^ although the three 
most used^ej^mples in psychology are physical modejs, cornputer models, and 
mathematical >K;>de>S. To make this clearer, cons icfer/:ttTe 'following two 
examples. It i s\becom1ng v-common practice in medical 'schools to use manikins 

^to teach neqphy te octctors about the reactions pf a- hum^^p body under certain 

conditions. These mah4kins have certain typical. h<jrhar)?^d^t ions bu1)lt ihto 
them such as pupil contractions, heartbeat, respiratory responses, /etc. 
Strictly speaking, such maM.1<ins are not exactly modkis but they are close 
enough to make a point. TheseC^manikins are physical ^njalogues to a human 
body. They are expected to produce a certain sample o^'responses to Specifi 
stimuli jTjst as a human body does. Not a^l 1 human responses, of course,^ are 
produced and the manikin is assuredly not the same thing as a humarr body; 
neverjtheless , it can act like a human body under specified condftion's. 
Because doctors and physiologists have observed ^regularities in behavior 
and h^ve certain ideas about why these regularYt^ies occur/.they can build a 
model to dupl icate* these responses. Another example of 'a model is the 
physical representation of atoms commonly found in science expositions. 
These models are again a representation in the physical domain of what 
scientists believe an atom looks like in the microscopic domalTT.' All such 
models have a neces,sary *'as-if" quality abo\it them, and they are Msually 
closely tied to theory! ^ Indeed, some writers contend that a model rs^a 
theory 'and they sometimes use these terms interchangeably. It is probably 
clearer to make the other assumption and say that a^odel-^wiW almost 
always represent a theo}"y although it will not, strictly speaking, be on^. 
We* wi 1 1 discuss computer models in. the chaptefpn information processing 
theories^nd mathematical models in the chapter on mathematical learning 
thee 



^Source: 'Snelbecker, G4en "E. LeaVnlng^ Theory , I nstruct ional Theor^ , 
and Psychoeducationa! Design !^ New Work: McGraw-Hill, 197^» PP. 32-33. 
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■ WEh Vjj?GINiA DEPARlkNT OF- EDUCAf 



BUREAU OF LEARN iNtS-SYSTEMS ' <> ^ • ;^ ' 

^ • , DIVISION *dF INSTRUCTIONAL LEARNING SYSTEMS ' " 

- * • masYery^ earning- belief system* • f' 

^' '■ ' ~ ' 'i 

1. Te.aching is a process concerned .wi th' the MANAGEMENT of learning. 

2. The role^^o^the teacher is to: / 
^ (^) specify whatx is to be learned, 

(b) moti vate%jipMs to learn It> , T^f^T^ 
(c}^ pi^ovTde pupils with instructional' mat^erials, 

(d) administer these le^arntrjg rrtaterials at a rate sui€^b.1e for 
each .pupi 1 , « / . " 

(e) mon i for pup i 1 s * progress", 

(f) diagnose di*fficulties and prov^ide proger remedi^at'rbn, * ^ ' 
.•*Cd) give revf^'W and practice that will main-tain pupits* learning 



over, long periods 'of time. 



^^ource: Block, Jf H. (Ed , ) ,'^ Mastery Learning : Theoryahd Practice . 
New York: Hol.t , Ri nehart £ Winston, IS^^-I, ^ ; 
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DEFINING CHARACTERfSTICS OF A CBTE MANAGEMENT SYSTEM r AJRATIONAtEJ 



Given the infinite organizational configurations possible, and the great 
variety of views regarding instructional management and the competency-bf sed 
concept, ^one is often hard put to justify a particular model as being superior 
to others. JH\s attempt Is a first approximation of putting together a /spe- 
► cific set of Qiai^agement system' characteristPcs. Since t+ie rationale builder 
has already J^tected flow of the rationale pres'ented here. 5nd has been made 
aware through the comments of colleagues of pertinent exclusions, it is fully 
expected that the present /state of this rat ionale -wlI 1 U be subject to much 
critfcrsiiT7-^BS- ifnshrnitd be. 

The thought that stimulated this exercise was the perception that indif 
vl duals espousing a compe,tency-based teacher^ educat Ion model must often in- 
stall their model under an existing management system that may or may not be 
conducive to the effective and efficient administration of their model. To 
Jth6 degree that the following rationale can.be trusted, it provides strong 
implications for the defining characteristics of a management system for a ' 
competency-based teacher\^ducation program. It should also pr'ovide a counter- 
response to those highly verbal col leagues <)f oufs, who for one reason or 
anotlfeV attempt to prevent the sucX^ssful adoption, of a CBTE program through 
a variety of ^verbal holding actionsV-^ , 

1.. GBTE requires a student to demonstrate mastery of learning * 
• behaviors, by meeting explicit performance criteria. 

2. Explicit performance cr'/teria implies expl ici t (performance 
objectives (behavior objectfi ves) . 

3. I'f a student is not permitted to advance until Jife has 
mastered prerequisite behaviors^ and'^since studerrts^ary 
in the length of time required to master a particular 
behavior, it is unreasonable^o expfect them to progress* 

at the same rate. ' ' u ^ , ' 

A. Therefore, mass instruction is. ndt a reasonable instruc- 
. , tionaJ alternative. ^ ^ . - 

5. . Since individual tutoring on a large scale is beyond the. 

means of most teacher education- insti^utions,\the most 
reasonablje'al ternat ive .is some f^erm of self-instruction 
through th^; technology of automation. , , 

6. While it is evident that many b^aviors can be learned 
through a self-instructional process, the state of the " 

-art is such that behaviors in the higher levels of tax- 
*onomIc categories, such as Synthesis and Evaluation, 
require ve|-bal interaction between and among Indlvldyals. 

J. IrpplicfT^In the above, statement Is the view that learners 
vary in the kinds of strategies that they apply to the 
learning of a specific concep't, and that the multlbranch 
condition of verbal interaction is one means of rearranging 
the learning stimuli to* fl)t f preferred' learning styl6. - ' 



CBTE Manasement System - 2 . * 
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8. If the above is true, then the skills required of a * 
^ . teacher or instructional maYiager in a CBTE program are 

different both in decree and kind from those required . 

of. a traditional program. 

9- First, if an instructional manager is to set up optimal 
learning conditions for students, he/she must be able 
to identify their learning strategy modes, or learning ^ 
^ styles, and ei ther^ develop conditions that compl^ement 
that mode, or train the student to use^ a different 
learning strategy that agrees with the in^^uctibnal 
system. 

10. Second, given that the instructor's personal interaction 
with the student will now be primarily concerned with 
higher levels in the taxonomy, the kinds and range of 

^ <^ ^student reactions will require a much greater subject- ' 
matter depth on the part of the instructor in the CBTE 
program, than was required in a more^ trad i t ional program 
where the student *S' focus an,d response could be more 
narrowly 'cofitrol led. / ' , » , 

11. The requirement of developing conditions ta complement a 
student's- individual Vearn.ing style is not limited to 
verbal interaction situations between the student and tl^ 
instructor, or other students^ but includes self-instructional 
situations* That is, for a group of students, a number of 

^ alternative sel f- i nstruct ional tracks complementing different 
learning styles, need to be-nd^veloped for the 'learning of a 
particular concept, or set of concepts. 

12. Third, the instructional manager must be §'killed in prac- 
ticing and teaching students'the use of skills that facil- ^ 
itate individualized learnCing (i.e.. Inquiry skills), 

13. It js doubtful that any one person can develop the plethora 
of skills and .knowledges required to effectively set up and 
manage' the conditions of learning Implied by the above 
requirements. 

<^ ^ 

]k. Therefore, an interdisciplinary approach will be required, 
• suggesting team management of instruction. / 

^]5- Since such an' interdisciplinary instructional team would 

cut across several college departments, resources Would be 
required of all departments for running th6' CBTE program. 

16. Because departments^ are organized to defend their resources, 

their structure Is viewed as antithetical to inteVdiscipl inary ^ 
tpam operation. / ' . 
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CBTE Management System' 3 

17. ' Smce the CBTE program is based on explicit performance 

objectives, all personnel, spatial, material, equipment, 
» and'process needs dan be relati^d directly to the objec- 
tives,. and to the effects of the -Instructional methods* 
as measured by the explicit performance criteria. Stnce. 
this data are available to the interdisciplinary instruc- 
tional team, they are able to. report these needs to the 
college budgeting authority (Division level?) in a very 
objective and defensible manner. ^ 

18. 'Since the above conditions are those primarily required 
for the operation of a Program Planni^ng, Evaluation, and 
Budgeting System (PPBS) , max *^mum efficiency could be 

• derived from the college's resource's. . - * 

19. There is no^reat evidence that suggests that any of the 
•responsibi 1 i'ties presently carried out by departments 
cannot be carried out as/ef f iciently by the teams and 
division level personnel: 

10. Slnce^the purpose of the CBTE program is to produce 
teachers who are effective* in changing thefr students 
behaviors, the effects of the CBTE program must be » related 
to, the teacher's effect on those students. 

21. This means that relationships must be estattlished with the 
/ public schools that will enable the setting up of conditions 
/to measure the effects of the teachers we prepare on their 
students.*.^ - . ' . 



.^Source:. Castelle G. Gentry, University of Toledo, Fall, 1972; 
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WHAT'S IN A NAME? 
, OR 

A ROSE BY ANY OTHER NAME... ^^ 

SOURCE * DESIGNATION 

Developing Teacher Competencies , Performance Objectives ^ 

James E. Weigand, Editor \ . ' 

Instructional Development Institute , Performance Objectives' 

Writing Behavioral Objectives , ^...Behavioral Objective's: 

H.' HVf McAshan 

^ Behavforal Objectives and Instruction , Behavioral Objectives^- 

Kibler, Barker 6- Miles . x 

Behavioral Objectives in Curriculum . Behavioral Objectives 

and Evaluation , Bernabei S Leles 

Preparing instructional Objectives , Instructional Objectives 

Mager 

Object! ves . For Instruction and ^ Instructional Objectives 

Evaluation , Kf bier , * Cegal a , Barker S Miles 

Planning ^ An Instructional Sequence Instruct ionat Objectives 

Popham 6 Baker 
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CONDENSED INFORMATION ON . 
"reparation and use of im^T.IONAL OBJECTIVES 



-AT. 



7 ' — ' * ' Object (-yes . . . ^ 

Once an instructor decides he/she will teach his/her students something, 
several kinds of act^jvity are necessary on his part if he/she Is to succeed. 
"He/she must first decide upon the «goa1 s Jjj^/she intends to reach at the end ' 
i>f his/her course or program;^ He/she must then select procedures, content, 
and methods that are relevant to the objectives: cau^ the student to inter- 
act with appropriate subject matter in accordance with principles of learning 
and, finally, measure or evaluate the student*s performance according to the 
objectives or goals originally selected. 

The first of these, the descript ibn .of objectives is the theme of the 
attached information. If you are interested in preparing instruction that 
will help you reach your objectives, you must first be sure your objectives 
are clearly and unequivocally stated. You cannot concern yourself with the 
problem of selecting the most efficient route to your destination until you 
know what your destination is. ^ 

' The attached material has been selected to expose you to this system. 
It is assumed that particip'ants will want. to pursue the subject further by 
studying the information developed by the authors. 

' PREPARING aBJECTIVES FOR PROGRAMMEDr INSTRUCTION 

^ " • Robert F. Mager 

. OBJECTIVES * ' 
'A. Terms which bear defining: 

1. BEHAVIOR - refers to any visible activity displayed by 
a learner (student). * . 

2. TERMINAL BEHAVIOR - refers to the behavior you would 
like your learner to be able to demonstrate at the 

time your influence over hJm/her ends* , 
' 3t ' CRITERION - Is a standard or test by which terminal 
behavior* is evaluated. 

II. WHY WE CARE ABOUT OBJECTIVES • • 

A. - Object ives 

Ap,.-efrjec t i ve is an intent communicated by a statement 
describing a proposed change in a jearner — a state-.* 
ment of what the learner is, to be like when he/sh^ has 
successfully completed a learning experience. Is a 
description of a pattern of behavior (performance) we 
want the learner to be able to demonstrate. 




B. 



Objectives - 2 



2. Another important reason for stating obj^ti ves'sharply 
- relates to the evaluation of the degre^;lp]r;^>?*iich the 
learner- i^s-able to perform in the ma£itl4M?^Vi red • 

Course Description:, JJ^ '-^^ . v-^v/< 



A coarse description tells you something atto'ut the cqn- 
tent 'aad! procedures of a course, a course^bject i ve 
descrjj^S;^, a desired outcome of a course J 



PREREQUISITES 



DESCRIPTION 



/ OBJECTIVES 



What a learner 
has to do to 
qual i fy for a 
course. 



What the course 
is about. 



What a successful 
learner is able to 
do at the end of 
the course. ' 



• *2. Whereas an objective te-lls,what the learner is to be like 
as aresult of some learning experiences, the course 
^"^'^ description te,lls only what the course is about. 

THE QUALITIES OF MEANINGFUL OBJECTIVES . 

A. Meaningful Objectives 

1. Basically, a meaningfully stated objective is one that 
successfully communicates to the reader the writer's 
instructional intent. * 

2. It is meaningful to the extent Ft conveys to others a 
picture (of what a successful learner, will be like) 
identical to the picture the writer has, in mind. Since 
a statement pf an objective is a collect ion'of words and 
symbols, it is, clear that various combinations may be 
used to express a given intent. ' 

3. A meaningfully^ stated objective .then^ is one that suc- 
ceeds in communicating your intent; the best statement 
is the one that excludes the greatest number of possible 

'alternatives to your goal. 

4. Urlfwilunately , there are many "loaded" words, words open 
to a wide range of interpr^etations. To the extent that 
we use ONLY such wordsi, we leave ourselves open^^&injj- 

' interpretation. \ 



Consider the following examples of words: 



Objectives - 3 



WORDS OREN TO FEWER 
INTERPRETATIONS 

to wri te ♦ 
to recite 
to identify 
to di fferentiate 
to solve 
to construct 
to list 
to complete 
to contrast 

5. ''What do we mean^ when we say we want a 1e°arner to "know" 
somS'thing? Do we mean that we want ,him/her to be. able to 
recite, or to solve, or to construct? Just to tell him/ 
her we waat^ him/her to "know*' tells him/her little — the 
word can mean many things, 

a. Though it is all right to include such words as 
understand and appreciate Jn a statement of (an 
objective, the statement is not explicit enough 
to be useful until indicates how you intend 
to sample the ojnderstand i ng and appreciat ing , 

^ b. Until you describe what the learner will be 

DOING when demonstrating that he understands or 
appreciates you have described very little at . , 
all. Thus^, the- statement which communicates 
best will be one, which descri-bes the terminal 
behavior of the learner well enough to preclucfe 
misinterpretation,' 

B. Writing Objectives * ^. 

I 

1, Identify the tferminall. behavior by name. We can specify 
the kind of behavior C^hich will be accepted as evidence, 
that the' learner has achieved th4 objective, 
• 2, Try to further define the desired behavior by de- 
scribing the important conditions under wh-ich the 
behavior will be expected to occur. 

IDENTIFYING THE TERMINAL BEHAVIOR ^ . ' 

A, An objective statement is used to the extent that it specifies 
• what the learner must, be able to DO or PERFORM when he is 

demonstrating his/her mastery^of the objective. 

B, The most important characteristic of a useful " object ive -is 
that 1 1 identj f !es the kind of performance which will be 
accepted as evidence that the learner has achieved the 
objective, ^ . 



WORDS OPEN TO MANY 
INTERPRETATIONS 

to know 
to understand 
to real ly understand 
to appreciate 
to f ui ly appreciate 
to grasp the significance of 
to enjoy ^ 
to bel ieve *• 
to have faith in 
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C. SUMMARY . 



1 . An instructional objective, describes ^£n intended^ 
outcome rather than a description or summary of ^ 
content. 

2. One characteristic of a usefully stated objective 
is that it is stated in behavioral, or performance, 
terms that describe what the learner will be DOING 
when demonstrating his/her achievement of the 
objective. 

3. The statement of objectives,, for an entire program of 
instruction "Wi H consist of several specific statements. 

4. The objective which is most usefully stated is one/which 
communicates the instructional .intent of the person 
selecting the objective. 



V. FURTHEff DEFINING THE TERMINAL BEHAVIOR 

A. By ^he. time you have written an objective which identifies 
the^behavior you will expect your learners to exhibit when 
they have successfully completed your program, you will have 
written a far less^ equivocal objective than most which are 
in use today. Rather than expect your students to d^e f ine 
what yoiPmight have i nTrrTllid when lis in g s ucFr~amiBT^g uou s words 
^as understand , know , or appreciate , you will have at ^least 
identified for him/her (and for yourself) the kind of activity 
^ which will be accepted as ^evidence of ach ievemertt . And more 

importantly perhaps, you will have begun to specify your con- 
~tent for your instructional program and which will provide 
you with a basis for evaluating programs prepared by- others. 

^ B. To state an object i v^^hat will successfully communicate your 
educational intent, you will sometimes have to fuiMrker define 
\_t^rminal behavior by stating the conditions you will impose 
, upon the learner when he/she is demonstrating his/her mastery 
of the objective^. Here are some examples: > 

. Given a problem of the following class... 
^ Given a 1 i st of. . . 

Given any reference of the learner's choice... 
Given a matrix of intercorr'elat ions . . . 
Given a standard set of tools... 

Given a properly functioning... *^ 
Without the aid of references..^ 
Without the aid of slide rule... - . 

* Without the aid of tools... ^ 

C. For example, instead of simply specifying to be able to sol ve 
p rob refits in algebra, we could improve the ability of the state- 
" ment to 'communicate by wording it something like this: 
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Given a linear algebraic equation with one \jnknown, 
the learner must be abl^ to solve for the unknown 
without the aid af refepenc^es, tables, or calculati/ig 
devices. ^ , 

How detailed should you be in your definition of terminal 
behavior? Detailed enough to be sure the target behavior 
would be recognized by another competent person/ and detailed 
enough so that other possible behaviors would not be mistaken 
for the desired behavior. Detailed enouglj, in other words, 
so that others understand your intent as YOU understand it. 

D. . Here are some questions you can ask yourself about your objec- 

tives as a guide to your identi fy ingMmportant aspects of the 
terminal behaviors that you wish to develop. 

1. What will the learner be provided? 

2. What will, the learner be denied? 

'3., What are the conditiphs under which you wi.1.1 expect 
the terminal behavior to occur? 

Are there any skills which you are specifically NOT 
tr/Ing to develop?— ^oes^the-ob-J e c tive e xclude such 
skills? 

E. SUMMARY 

1. An instructional .object i ve is a statement that describes 
an intended outcome of instruction. 



2. An objective. Is meaningful tb the extent it communicated 
an instructional intent to its reader, and does so to the 
degree that it describes or defines the terminal behavior 
expected of the learner. ^ 

3. Terminal behavior is defined by: 

a. , identifying and naming the observable act which wj 1 1 

be accepted as evidence that the learner has aclj^ieved 
the objective, and by ' 

b. describing the conditions (given, restrictions) 
necessary to exclude acts that will not be accepted 

as evidence .that ^the learnerJias^ achi eved the ^ ^ 

. object ive: ' 

STATING. THE CRITERION ,^ ^ • \ 

A. Now that we have described what we want the learner to be able ^ 
to do, we can increase the ability of an objective to communicate 
by telling. the learner HOW WELL we want him/her to be able to do 

4 \t. We will accomplish this by describing the criterion of 
acceptable performance. 

4 

B. Probably the most obvious way to indicate a lower limit of 
acceptable performance is to specify a time limit where one 
Is appropriate. 



■ Objectives - 6 •« 

ft * ^ 

If for example, we are teaching mathematics and expect our 
stojdents to develop a certain amount of problem-solving 
proficiency, we might use these italicized words \n our 
objectives: 

"The student must be abje to correctly solve at 
least seven simple linear equations within a peridcl 
of th i rty minutes . " 

One of the ways of defining acceptable performance, then, is by 
indicating a time limit — whenever a time limit is intended. 
Another way to indicate g criterJ[on of successful performance 
is to specify the minimum number of correct responses you will 
accept, ^or the number of prfncfples which must be applied in a 

• given situation, or the numbei^of prifici'ples which. must be 
spelled correctly. For exampl^: 

"Given a human skeleton, the^student must be able to 
. correctly identify by labeling at least AO of the 
following bqnes: there will be no penalty for 
guessing (list of bones inserted here)," 

•a 

We see' that the minimup acceptable skill is specified in'terms 
of the number of bones to be identified^. The student must be 
able to correctly identify at le|^st kO items and he/she is 
encouraged to guess. 

An alternative to indicating number is to indicate percentage o 
proportion. Thus, if appropriate, we could indicate that: 

"The student must be able to, reply in grammatically 
correct French'to 95^ of the French quest ions ' that 

• " are put to him/her during the examination." 

or we could specify: ^ * ^ 

"The student must be able'to spell correctly at least 
80^ of the words called out to him/her during an 
examination period," 

or we_could s]3ecify: 

' "The stiJdent must be able to write the name/ and 
addresses of at least three-f i^f ths of .the five 
New York doctors who recommend the ingredients in 
Brand X," 



1- 

One good way to'get ^^kted is'' to look over tite examinations 
you use; these wiVI MHTyou^what you are us^ng as standards 
of performance and -you can improve youf objectives by putting 
these stand<^r^ds into words. Once this is done,' you can ask 
these questions »of your statements to test their clarity and 
completeneT^: 
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t 1. Does thfe statement describe what the learner will be 
.doing when he/she is demonstrating that he/she has 
reached the objective? 

2, Does tlie statement describe the important conditions 
(given and/or restrictions) under which the learner 
will be expected, to demonstrate his/her competence? 

3. Does the statement indicate how the learner will be 
evaluated? Does it describe at least the lower limit 
of acceptable performance? 

F, FINAL SUMMARY 



K A statement of instructional objectives is a collection 
of words or symbols descr i bi ng 'one of your educational 
i ntents > 

2, An objective will communicate your intent to the degree 
yoO' have described what the Jearner will be DOING when' 
demonstrating his/^^er achievement and how you will know 
when he/she is doing it, 

3, To describe terminal behavior (what the learner will be 
DOING) : 

a. Identify and name the over-all behavior act, 

b. Define the important conditions under -which the 
behavior is to occur (given and/or restr i ct r^ons 
and 1 imi tations) • ^ 

c. Define the criterion of acceptable performance. 

Write a separate statement for each objective; the piore 
statements you have, the better chance you have of making 
your intentions clear, 

5. If you give each learner a copy of your objectives, you 
may not have to do much else. 



Source: Preparing Instructional 6bjectives , Robert F, Mager, 
Fearon Publishing Company, 828 Valencia Street, Palo Alto, California 

Educational Objectives , Vimcet Associates, P, 0, Box 2^71^, 
Cos Angeles, California 9002^ ' 
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MAJOR CATEGORIES *IN THE COGNITIVE POHAIN 
(Bloom, 195^) ; T 



Descriptions of the Major Categories in the Cognitive Domain 



1. ^Knowledge , knowledge Is defined as the remembering of previously 

learned material. This may involve the recaU of a wide range of 
materidl, from specific facts to complete theories, but all thaj^ is 
required is thejiringing to mind of the appropriate information. < 
knowledge represents the lowest level of learning outcomes in the 
cognitive domain. 

2. Comprehens ion . Comprehension is defined as the ability to grasp the v 
, meaning of material . This may be shown by t ran slat ing material from ^ 

one form to another (words to numbers), by interpreting material 
(explaining or summarizing) , and by estimating future trends (pre- 
dicting consequences or effects). These learning outcomes go one 
step beyond the simple remembering of material, and represent th^ 
lowest level of understanding. 

, £ 

3. Appi i cat I on . Application refers to the ability to use learned mate- 
rial In, new and concrete situations. This may include the appl ica^ 
tlons. This may Include the application of such things as rule^ 
methods, concepts, prTnclpTes, laws^ and theories. Learning out- 
comes in this area require a higher level of understanding than 
those under, j:omprehefK^Sifi. y 

*U ' 

— - -'■ - i ■■ • ' 

^- Analysis . Analysis refers tp the/abi 1 i ty to break down material 

into Its component parts so thatr its organizational structure may be 
understood. This may Include the Identification of the parts, 
analysis of the relationships betv^dn parts, and recognition of the 
oi^fanT^ational principles Involved, teaming outcomes here repre- 
sent a higher intellectual level thah Comprehension and application 
because they require an undprstan^ng of both the content and the 
structural form of the material. V -^^ 

5. Sytithesis . Synthe^i s /efers to the ability to put parts together to ^ 
form a new whole. 'This may involve the production of a unique com- 
munication (theme or speech), a plan of operation (researcfi pro- 
posal), or a set of abstract relations (scheme for classifying 
information). Learning outcomes »n ^hls'^rea stress creawtive 
behaviors, with major enphasis on the formulation of'^new patterns 
or structures. ^ 



> If 



'SOURCE:- GronJund, N. E. Measurement and evaluation ln^|teaching .^)'» 

New York: The MacMillan Company, 1971. .'^ ^ ' 



Pi^^ess Terms For 
Essential" Competencies 



Observable Behavior Verbs For^^ . 



Learner* Outcomes 



1^ 



i^ow contnon tferms ** 
Khow specific faqts ^ . 

Knowwethods and procedures 
[)em<^str&te knowledge of basic 
' ^concepts * , ^ 
Demonstrates knov^ledge of principles 



Def ines descr i bes , identifies, 
labels, lists, matches, n^mes, out- 
lines, reproduces, selects, states 



Understand facts and principles 
Interpret verbal material 
Interpret charts and gr^pl^ 
©Translate verbal material* to mathe- 

* mat i^al • formulas 
<^EstitHate future consequences implied 
> in data 

^Justify methods and procedures 




Converts, defenoi^, distlngu^shes , '^Jf, 
estimates, explain, e>tt<^Mls? gener-*' 
alizes, g^ives exampl*^^ Jrtfers , 
paraphrases, predicts, rewrites,*, 
summarizes- 



Apply concepts and principles to new 

situations. 
Apply laws and theories to practical 

situations " 
Solve mathematical problems 
Construct charts and graphs 
Demonstrate correct ^Jsage of a 

method or procedure » 



Changes , '^computes , .demonstrates , di s- 
covers, man i*pulates , modifies, oper- 
^ates, predicts, prepares, produces, 
relates, shows, solves, uses 



Recognize unstated assumptions 
Recognize logical fallacies in 

reason! ng 
Distinguish between facts and 

i n ferences 
Analyze the organ izat ion^ 1 'structure 

of a work (art, music. Writing) 



y Breaks down, diagrams , differentiates, 
^scrimfnates , identifies, illus- 
trates) infers , .putl In^s , points out, 
relates, selects, separates, sub- 
divi<fes \ 



Write a well organized theme' 
Give a well organized speech 
Write a creative short story 

.(or poem, or music) ^ 
Propose a plan for an experiment 
Integ^t'e learning- from different 
areas into a plafi for solving a 
problem 
Formulate a new scheme for 

classifying objects (or events, 
^ or ideas) ^ 



. Categorizes, combines, con^lies, com- 
) poses, creatfes, devises, designs, 
explains, generates, modifies, orga- 
nizes, plans, rearranges, revises, 
rewrites, sumraarfzes, tells, writes 



6. Eval uation . Evaluation is concerned with the ability to judge the 
value of material (statemenT, novel, poem, research report) for a 
given purpose. The judgments are to be based on definite criteria. 
, These may be internal criteria (organization) or external criteria 
(relevance ttT the purpose) and the student mdy determine the 
criteria or be given them. Learning outcomes if) this area are 
highest in the cognitive hierarchy because they^jCQQta i n elements 
of all of the other categories, plus conscious value judgments 
based on clearly defined crfteria. 



Judge th^ logical consistency of 

written material 
Evaluate the adequacy with which 

conclusions are supported by data 
Assess the value of a w6rk (art, 

music, writing) by use of internal 

cr I ter la 

Appraise the value 'Qf a work '(art, 
music, writing), by use of external 
standards of excellence 



Compares, conclutjes, contrasts, 
criticizes, describes, discriminates, 
explains, justifies. Interprets, 
relates, summarizes, supports * 



Ov 
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^ \ MAJOR CATEGORifS IN THE AFFECTIVE DOMAIN ' 



Descriptions* of the Major ^Categor ies in the Affective Oc<naln ^ 

1. Receiving / Receiving refers to the studerrt's willingness t6 attend 
to particular phenomena o^- stimuli (classroon activities, textbook, 
music, etc.). From a teaching, standpoint, it Js concerned with 
getting, holding, and directing the studenfs attention. Learning 
outCQjnes in this area range fron the simple awareness that a thing 
exists to selective attention on the part of the learner. Re- 
ceivir>9 represents the lowest levej of learning outcomes in the 
affective domalo. ^ 

2. Responding . Responding refers to active participation on the part 
of the student. At this level he not only attends to ^ particular 
phenomenon but also reacts to it in some way. Learning outcomes in 
this area may emphasize Acquiescence in responding (reads assigned 
material), wlFllngness to Respond (voluntarily neads beyond ass^ign- 
roent), or satisfaction in responding (reads for^ pleasure or enjoy- 
ment). The higher levels of this category include those Instruc- 
tTonal objectives that ace'^f omnx>oly class if i^ed under "interest'*; 
that' is, those that stress tKfe seeking .out ^and enjoyment of 

/'particular activities. 

^* Valuing . Valuing I s .concerned, wi th the worth or value a student 
"——attaches to a particular object, phenomenon, or behavior. This 

ranges in degree from the more simple acceptance of a value (desires 
to improve group skills) to the more complex level of commitment- 
(assumes responsibility for (he effective functioning of the group). 
Valuing" is based on the Internal izat Ion of a- set of specified 
.values, but clues^ to these Values are expressed in the "Student ' s 
overt behavior. Learning outcomes in tlxis area are concerned with 
behavior ^hat Is consT'stent and stable enotigh to make^thtf value 
clearly identifiable. Instructional objectives that are commonly 
classiffed under ^'attitudes" and "appreciation" -would fall into 
th i s category. ^ ' ~ . 

~. ~ I ' ^ 

Organtzat ion . Organization is concerned with bringing together ^ 

different values, ^solving conflicts between them, and beginning 
the building of an Internal 1 y' cons i stent value system. Thus thd 
emphasis is on comparing, relating, and synthesizing values. 
.Learning outcomes may be concerned with the conceptualization of 
a value (recognizes the responsibility of each individual -for 
improving human relations) or with the organization of a value**- 
system (develops a vocational plan that satisfies his need for 
both ecdrfomic security and social service). Instructional objec- 
tives. relating to the develop^^cnt of a philosophy of, life would 
fall into this category. 
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5. Characterization by a Value or Value Complex . At .this level of the 
affective domain, the individual has a value system that has con- . 
trolled his behavior for a sufficiently Jong time for him to have 
developed a characWI'i^t ic 'Tife style." Thus the behavior is 
pervasive, consistent, and predictable. * Learning outcomes at* th-is 
level cover a broad range of Activities, but the major emphasis Is 
on^ the fact that the behavior is typical or characteristic of the 
student. Instructional objectives that are corfcerned with the 
student'i general patterns of adjustment (personal, social, 
emotfonal) would be appropriarte here. | 



/ 

SOURCE: 



Gronlund, N. HeasuremeHt and Evaluation in teaching * 
New York: The MacMj I Ian Company , 1971. * 7 



Process Terms For 
E s sen t i a I Compe tenc i es 



Observable Behavior Terms For 
Learner Outcomes 



Listen attentively 
Show awareness of the irnportance of 
learning 

Show sensitivity to human needs and 

social ^problems 
Accept differences 6f race and 

culture 

Attend closely ^to the classroom 
activities 



Asks, chooses, describes, follows, 
glves^- holds, identifies, loca'tes, 
names^ points to, selects, sits 
erect, replies, uses 



tomplete assigned homework 
Obey school rules 
Participate in class discussion 
tomplete laboratory work." 
'Volunteer for special tasks 
Show interest l,n* subject 
Enjoy helping others 



Answers, assists, complies, conforms, 
discusses, greets, helps, labels, • 
performs, practices, presents, reads, 
recites, reports, selects, tells, 
writes 



Demonstrate belief in the democratic 
process 

Appreciate good literature (art or 
music) 

Appreciate the role of science (or 
other subjects) in everyday life 

Show concern for th^ welfare of 
others 

Qemonstfate problem-solving attitude 
Demonstrate commi tment ' to' socia 1 
improvement 



^Completes , describes, di fferentiates, 
explains, fol lows „ forms , initiates?, 
invites, joins, justifies, proposes, ^ 
reads, reports, selects, ^^ares, 
studies, works ^ 



Recognize the need for balance 

between freedom and responsibility 

In a -democracy 
Recognize the role of sys'tcma'tlc 

planning in Solving problems- 
Accept responsibility for his own 

^behavior • 
Understand and accept his own V 

strengths and limitations 
Formulate a life plan in harmony 

with his abilities, interests, 

and bej iefs • 



Adheres, alters, arranges, combines, 
compares, completes, defends, 
explains, generalizes, identifies. 
Integrates, modifies? orders, 
organizes ,. prepares , relates , 
synthesizes 



Display safety consciousness 
Demonstrate self-reliance In working 

Independently 
Practice cooperation In group 

activities : 
Use objective approach in prpbl'ert ^ 

solving 

dcmonstrafe Industry, punctuality*^ 
^ and self-dlscipUrie f 
Maintain "^Qod health habits 1 



A Acts I dl scrlmlYiates , displays, 
' ences\ listens, modifies, perf 



Inf lu- 
performs, 

practices, proposes, cjuallTles, ques- 
tions, revises, serves, solves, uses, 
verifies l 



Q 
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MAJOR CATEGORIES IN TKjl PSYCHOMOTOR DOMAIN 
^ (Simpsort*\)M5) ' 



Ocscr/pttons of the Major CategorfelVf n the Psychomotor Domain 

7 — ; ^1 — 4i 

1. Perception . This is an essential H^St step in performing a motor 
act J \t--\s the process of becoming {sWare of objects, qualities, or 
relation's by way of the sense organs V It is the central portion of 
th|f situation interpretation - acti^^ofi chain leading to purposeful 
motor activity.^ It is divided into tt(e 'areas of sensory stintla- 
tlon, cue selection, /and trans Ut ion |o¥ percept ion to action in* 
performing a motor act, ' u 



2. Set . . Tbjs is a preparaCory adjustment of_ readiness lor a" particular 
V • kind df-actioa-or-«xp^ience. Three aspects of setifflave been iden* 
tified: mental, physical, and emotional. 

\ 



> 



3. Guided Response . This is an overt behavioral .^ct of a learner under 
the guidance of ^the^ instructor. It is an early step in the develop* 
ment of a sKl^l and emphasis is upon the abilities which are com- 
ponents of the more complex skill. There are two major sub- 
categories: 1) imitation and 2) trial and error. 



Mechan ism . Learned response has become habitual. At this level, 
the learner ha3 achieved a certain^ confidence*) and degree of skill in < 
the 'performance of an act. The response may be more complex than at 

ng of response in 
mbined i|n action of 



the preceding 'level ; ,|t 
carrying out the task] 
a ski 1 1 nature. " 



may involve jjome pat-tern 
That is, abilji^ies are p< 



Complex Overt Respons^ , At this levil, thejlearher can ierform a 
motor act that is conj'sidered complex' because of the mave )ent pattern 
required. A high degre**^of skill is evident. The task :an be 
carried out smoothly and efficiently wl^ minimum time aid energy^ 
There are two subcatecjbries : 1) resolut ion*^ of uncertalrty and 
2) automatic performance. 



SOURCE: Simpson, E.* J. The classification of educational objectives ;- 
Psychomotor domalrT University of Illinois, 1965- 



Performance Terms For 
Esse^itial Competencies 



Observable Behavior Verbs For 
Learner Outcomes 



Sensory Stimulation 

Sensitive to auditory cues in plying 

a musical instrument 
Awareness of difference in texture of 

various materials 
Sense the flavors in seasoning food 
Cue Selection 

Recognize the operating difficulties 
.with giachinery via sognd - 
Sense where the needle should.be set 

i n machine st i tching 
Translat ton 

Relate music to dance form 
Follow a recipe in preparing food 

Mental 



Knowledge of steps in setting the 
table 

Knowledge of tools appropriate to ' 

perform an operation 
Physical 

Achieve bodily stance preparatory to 
bowl ing 

Position hands preoaratory to typing 
Emotional * 



Desire to operate a drill press with 
skill, 

^Disposition to perform sanding to 
best of ability 

Iml tation 

Perform dance step as demonstrated 
Demonstrate flexibility exercises as 

modeled by the teacher 
Trial and, Error . y.^ 

Discover the most efficient method of.^ 

finishing hardwoods 
•Ascertain the sequence of cleaning a 

rex* through trial of several 

patterns 

Perform a hand-hemming operation 
Mix ingredients for a butter cake 
Construct an*ellipse using the four- 
center i>ethod 
Prepare al lathe for a face plate 

ttrning ^ * 
Pollinate aiyoat flower 

Resolution of Uncertainty 

Operate ai roil l ing machine 

Set-up ant operate a production band 

saw I 
Automatic/ Performance 
Perform b^sic steps of populor dance 

steps I 
Tal lor a suit 
Perform on the violin 



Use the "ILLUSTRATIVE VERBS FOR 
STATING SPECIFIC LEARNING OUTCOMES" 
(especially the Laboratory and manip- 
ulative behaviors section) on the 
following two pages to locate observ* 
able behaviors for your psychomotor 
enabling objectives. • 
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ILLUSTRATE VERBS FOR STATI'NG SPECIFIC LEARNING OUTCOMES* 



^'Creative BehaCriors' 



Alter 

Ask 

Change 

Design 

General ize 

Modify 



Paraphrase 
Predict. 
Quest ion 
Rearrange 
Recomb i ne 



Reconstruct 
Regroup 
Rename 
Reorganize 
-Reorder 



•^.^^^ephrase 
-"^Rest^te 
Restructure 
ReteLl 
Revise 



Rewr i te 
S imp] i fy 
Synthesize 
Systemati ze 
Vary 



Logical , Judgmental Behaviors 



Analyze 
Apprai se 
'Combine, 
Compare 



C^ncl ude 
Contrast's 
*Cr i ti cize 
Decide 



Deduce 
Defend 
Tvaluate 
Exp la In 



General Discriminative Behaviors 



Formulate 
Generate 
I nduce 
^* Infer ^ 

\ 



V 



>^-P1an 
^STructure 
Substitute 
Substitute 

i 



Choose 
Col lect 
Define* 
Descri be 



Detect 

Differ^ni^iate 

Discriminate 

Distinguish 



I dent i fy 
Ind icate 
Isolate 
List . ^ 



Match 
Omi t 
Order 
Pick- 



Place - 
Point 
Select . 
Separate 



Social Behaviors 




Communicate 
Compl iment __ 
Contr i bute 
Cooperate 
Dance 
Di sagree 



Di scuss 

Excuse 

Forgive 

Greet 

Help 

I nteract 



Laboratory and Manipulative Behaviors 



v: 



Invite, 
Join 
\augh 
Meet ' 
Participate 
Permit 






Apply ^ * 


Demonstt'ate 


Keep ^ 


Perform 






• Ca Vibrate 


Di ssegt 
Draw * . 


'..^ Lengthen 


Prepare 






Calculate- ♦ 


LimitV ' 


Remdy.e - 






Check 


Feed 


^Manipulate 


Repat> 






Condirpt 


Grow 


Measure 


* Replace 






Connect ' . , 


1 mplemeht ' 


Move 


Report 






> . Cons;t ruot- 


• Increase " 


^ , , Operate 


Reset ^' 






Convert 


Jnser.t . 


I' Plant 


Set ' 




A 


Decrease- 






Sketch- 
Solve 






* 






• 

< * 
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Volunteer 



Spec'i f y 

Square 

Straighten 

Time^ 

TransiBer 

Weight 
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Arts Behaviors 

Assemble Dot 

Blend Draw-^ 

Brush Drill* 

Build 'Fdld 

Carve Torm ^ 

Colqr ' Frame 

Construct Hammer 

Cut^ , Handle 

Dab Heat 



lllus 
Melt 
Mix 
Mofd 
Nail 
Paint 
Past4 
Pat \ 
Pour""" 



t/^te 



Press 

Roll 

Rub 

Sand 

Saw 

Sculpt 

Shake 

Sketch 

Smooth 



Stamp 

Stick 

Stir 

Trace 

trim 

Va rn i sh 

Wipe 

Wrap 



^^'Study" Behaviors 



Arrange Compile 

Categorize Copy 

Chart Diagram 

Cite Find 

Circle > Follow 



I temize 

Label, 

Locate 

Look 

Map 



Mark 
,Name 
Note 

Organ ize 
Quote 



Record 
Reproduce 
Search 
Sort 

Under 1 ine 



General Appearance, Health, and Safety 



Buttop 

Clean 

Clear 

Close 

Cover 



Dress 
Drink 
* Eat 
El iminate 
Emp'ty 



. Miscellaneous 

r— 7 

. Attempt ' 

• Attend 
Begin 
Buy 
Come . 
Comp lete 
Conis ider 
Correct 

' Crease 
, Crush ; 
« Designate 
Determine 
Develop 
Discove/ . 

• Distribute 
06 

y Orpp V. ^ 
End*' ' 



0 Erase 
txpand 
Extend 
* Feel 
Fit 
Fix 
Clip 5 
Get 
Give 
Grind 
Gu i de 
Hand 
/Hang 
Hold " 
Hook) 
Hun44 • 
I ndude 
Inforrrf 
Uy/ 



Fasten 

Fill 

Go 

Lace 

Stop 



Leiod '* 

Let 

Light 
.Mend 
^•^Miss^ 

Offer 

Open ^ - 

PaVk*^^ 

Pay 

Beel 
/'Pin , 

f^osi t ion 

Present 

Produce 

Propose' 

Provide"* 

Put" 

Raf s'e 



Taste 
Tie 

Unbutton 

Uncover 

Untie 



Relate 

Repeat 

Return 

Ride - ' 

Save 

Scratch 

Send 

Serve 

Sew 

Share » 
Sharpen 
Shoot ^ 
ShcJrten 
Shovel 
Stiut 
S igni fy 
Slip ^ 
^.de 
o^ead 



Unzi p 
Wait 
Wash 
Wear 



Stake 

Start 

Stock 

Stcjre 

Suggest 

Supp ly 

Support 




*TAKEN from stating BErtAWORAL Ob/jECTIVES FOR CLASSROOM UiSTRUCTlON by 
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Norman Gron.lund 
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OBJECTIVE/ ITEM CHECKLIST'^ 



• !• What performance Is stated in the objective? 
2, What is the performance? 

INDICATOR 



MAIN INT^T 



CAN'T TELL 



OVERT 



cov 



ERT? 



M^in intent is clear? 



Add an indicator 




, YES v^NO 



— ^ 



Clarify the 
•objecf\i ve 



Test the indicator; 
revi se as needed 



3jwjrfhat overt performance is asked fo? by the objective? 

Si^^Eprm^nce is asked for by the Item? 
5j"^\^^S5tHe per'^^mances- match?. ^ . , 



NO 



Revise gi 



YES 

. M/ ' 



6. Do objective and item, condi tiops^ma^ 
YES m'^ 



reject the item 



Rev 




se or^eject the it^m 



Item is potentially usefuf Jfor testing 
whether , the' objective has Seen achieved. 



'*Courtesy of Mager Assad ates 
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Name: 




uv^jriculum Area: 



DIRECTIONS: List under the headings below the taskk whi ch yucFw^^a^ 

plish in thi s workshop. ^ Thi s learning* pon-tract wi 1 l'''at>t as a 
reference point to measure your p^^ogress during and at the end 
of the workshop. The number^ in parenthesis refer to the wor|< 
shop's enabling objectives. ^ ' " , ' - ^ 



1. t Share (1, 5) my personal beliefs §bbut learning 

systems 

2. Assfsf (3, ^) others in achieving the objectives 
^^of the work shop ' " ' 

3. Discriminate the domains (6) and levels (7) "Of* 
.learning 



Discriminate (8) the^ elements of ,termi na T dnd j 
enabMrtg objectives r 

5. Write, (9) original terminal iand enabling obj-ec-l 
tives in the«-three domains of learning 

^ » 

6. Identify (11) and explain (V2, 13)^ the elements 
of the learnjng system ^ ^ 

7. Write (2,. 18, 19/20) an ol-i^inal example of a^ 
learning system / ' . 

t ]' ' > ^ ' ' 

J 8. Analyze" and evaluate (1^) m^J^^learn ing system 

j . r • 

9. Identify (15) and explain (16) the basic pr-tn^ 
^clples of flowcharting educational. tas>5 



J. 



10. Flowchart (17) your learning system activities 
^Comments may be, continued op hack of $s^e. • ' - 



Achieved 


<U - 


<u 

fD > 
<i> 

fD a 

Q- < 


Not 

Achieved 




• 










• 










» - 










ft 

























































WEST VIRGINIA DEPARTMENT OF EDUCATION 
'M^EAUOF LEARNING SY-STEMS 

Divis,ioN= OF ^Instructional. LEARNING systems' 

WORKSHOP EVALUATION 



it'* 



Tell It like it is! 



Check one or more of the days you fee] yo^j learned the most during^this 
workshop. a ^ * 



Monday 
Tuesday 
Wednesday 
Thursday 
Friday * 



Ci rcle the, face that best agrees wi th your fee] ings> 







I w I 



Comf ]ete any of ^^he^ serf£ences which you , fee] are appropfr iate > 



sh tW^ we 




I rea ] I'y- ] i ked - the way 



it seems to me that- 




What this workshop "needs is 
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WEST VIRGINIA DEPARTMENT OF EDUCATION 
' BUREAU OF LEARNING SYSTEMS ' 
DIVISION OF INSTRUCTIONAL LEARNING SYSTEMS 



PRB-ASSESSMENT CHECKLIST 



Mame 



Date Completed 



Part I. DIRECTIONS - In order jtd. determine your entny level in regard to the 
V objectives for this workshop, answer yes or no to the following 
''questions. Use the comments column to provTde additional information 
to your responses. v • 



Yes 



No 



Comments 



Are you familiar wj'th sys- 
teffia^tic approaches to 
instruction? ^ ^ 

Can you design a learning 
sequence based on a system's 
approach? 

Can you .design flowcharts 
describing '1 earn irg' tasks? 

Can you d'c^riminate the 
three domains of behavior? 



5.j ' C-^n you d i scr imlinate thej 
levelslof the domains? 

y.^M^^ 6L Can you ^dentify the 

elements of j a "term^i^^^ 

objective? i ; 

7. .Can you identify the*' 
' e1,§ments of an ena'bling i 
objfectiv^? 

"81 Can you discriminate 
between, terminal and 
. ^enabling objectives? 

9. iCan you write terminal/ 
enabl ing .objectives that 
ref 1 ect tHe , e 1 emen ts^ 
» rdent'ifled in Nos. 6 *. / 
and 7? . . ^ . 



er|c 




4' . •/ 
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Preassessment Checklist - i 



Yes No, ' Comments 



10. Can you match learn in^^ 
objectives with modes 
of instruction? 



Part II. In the space below, define the term model. 



Part UMI 



In t,h^ space below, flowchart an education ta^k (i.e., the 
processes, decisions, etc.). ' 



\ 




/r- 
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* 

PARTICIPANT DATA QUESTIONNAIRE (PDd) 
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I . Check your sex : \ 



Male ^ 
Female 



2. Check your age category: / 



25 or under 

26-30 

31-35 

36-40 

41-45 



46-50 
5f-55 - 
56-60 " 
61-65 
65 and up 



3. 'Check the highest* formal educationaLlevel you have ,atta i ned»:. 

\ High School^ or Less 

Post Secondary, Technical, or Business School 

o f Bachelors Degree ' ' , 

Bachelors Degree Plus 

Masters Degre'e 

Masters Degree Plus ^ / 

Doctors Degree ' v : 



Indicate the number o| years, to. the nearest one-half year, of years of 
classroom teaching ex|et: ience , 'at any, level, you have completed. (One 
year is taken to be onfe school year. I.e., 9-IO months.) 



ye ars 



5. Indicate 



exper iencje" you have 
9 or I4 months each 



5trat I ve 
ei ther 



the number years of educational supervisory or admini 
completed. Th<i number of years, which may be 
foif this response are me^nt to be exclusive of the 
years- J n the qu^stic|>n number faur response. * ^ \ -l . ' 



years 



|» Check the edtjiicat iQnal level you most identify or deal with: 



El ementary 
Secondary 

Elementary andj secondary combined 
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LAST k S.S. NOS. 



WEST VIRGINIA DEPARTMENT OF EDUCATION" ' 

■ BURylu OF LEARNING .SYSTEMS ' 

DIVISION OF INSTRUCTfQyAL LEARNING sYSTEM?' ' 

♦ 

SELF-RATINGS OF WORKSHOP jTOP I CS (SOWT) 



Dl RECTMONS: 



Give yourself a 
1 i sted in "the ri 
scale below. 



point value for each ^f the currlk;urum concep-ts 
ght-hend column in accordance ^th^* the numerical 



1. The^term has no meaning 

' to me. * ^ 

2. I have heard or.' seen the 
term,- 'but the concept is 
unclear. 

i 

3. I have a genera> -ideeTaf 
the meaning.* 

k. I have some specific 
knowledge and/or ""expe- 
rience with^th'is Qoncept. 

5. I have studied the topic 
io depth and/or have had 
muth contact through 
observation or practice, 

• 1 




10 

'1'1 

"12 
'13 

'\k 

"15 
"16 
"17 
"18 

"19 
20 
21 



j ti vi ty Tr-aifrrrhg ^ ^ 
ins of Benavior 
Di.^^reji^iated ^taffrng 

ting . ' \ 

Com'pQTej-Ass i s ted I nstruct i on 
Learning ^Pacl^ge's . 
Micro-Te^chingN^ ' ^ 
Educational P^k" 
Instructional Objectives 
Paraprofess iona 1 
"interaction Analysis ' ' 
/ (Srff)ensatory Educat ion 
A Learning ^yst*em Model 
Nati onal Assessment ^ 
Perfdrmancb- Cbnf tracts^ 
S imu lat ioni Games - ' 
Vouctter Pjjans j v 
'Mini-iCj>ffrses , i * . \L 
■ Cri t^*on-Referen<;ed Measurement 
^Humanist-ic Educa'^^on 
. I nd i vidual i zed I nst ruct ion ^ 
^ccountab i 1 1 ty /; \ * 

CompeJ^ncy-Based Education 



LAST k S.S.. NOS, 



WEST- VIR%tN^A DEPARTMENT OF EDUCATION 
.BUREAU OF LEARNING SYSTEMS 
DIVISIOI^ OF; INSTRUCTIONAL LEARNING SYSTEMS [ 

VALUES INVENTORY PAGE (VIP)" ' ' 



DIRECTION^: Below, you will fihd a set of six valTiep with a short phrase 
explaining the value named. Beneath e^ach value- is a scale 
ranging from 1'(the lowest point value)/ to *10 (theihighest 
point value). You are to determine how much each stated 
value means to you along the continuum represented by the 
I'-IO point value scale* Ind^icate by a check mark, etc., a 
point along the scale as drawn that ,corresponds to the 
'importance you attach to the value. 

* Last, rahk'the values in order of their importance to you. - 
" Indicate your rankings'by placing the number (one being 

highest) of each value's rank in the box in front of the 
values name.' . * , ^ 

A'. EQUALITY, brotherhood, equal opportunity for all , 
■2 3 h 5' 6 7 8 9 10 

I — • ' . — ■ ; — I 

Q^. B.. TRUE FRIE^iDSHIP, close companionship " ■' ^ 
... 



2-3, h 5 ' 6 7-8 9 - 10 



A. 



/ 



-T 



I I 'C. WISDOM^, a mature understanding of life*., • " 

1 - 2' ,3- ■• 4 ' 5.. ■ 6 7- 8 9 10 

' • h ^ ■ ^ — tI 

I I D. ■ IMAGINATIVE,' daring, cregtiye 

1 2 3 4 5'6M 8 .9 10 

I ^ — ■ 



I I . E. LOGICAL, cons i stent i rational 



2 ■ '3 ' ^ 5 6 -7 8 9 10 



□-F, INNER HARMONY, freedom from inner conflict 



/ 



5 ' 6 7 8 9 ' 10 
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LAST ^ S.S. NOS 



WJ-ST / 1 RG IN I A' DEPARTMENT 05^%DUCATI0N 
BUREAU OF LEARI^ING SYSTEMS 
. DIVISION' OF INSTRUCTIONAL LEARNING SYSTEMS. 

POST WORKSHOi; EVALUATION (PQWE) ' _ , 



During the past week you have participated in a mastery learning, com- 
petency-based workshop focusing on developing learnrng systems, In order 
to obtain feedback about your perception and attitudes toward the workshop, 
please react to the following items. . ' 

PART I WORKSHOP ENABLING OBJECTIVES - Indicate the extent of your agreement 
with \he following items by ci rcl ing SA (Strongly Agree)', A (Agree)*, ' 
D (Disagree), or SD (Strongly Disagree): 



The workshop enabJing objectives: / 
]) helped me to recognize kpecifically what 

performahces I did during the work§+iop SA - A D SD 

""2) he'lped me to recognize specifically how ... 

well I completed the expected performances . , SA , A D SD 

3) prescribed standards which helped me to ' • 

self-evaluate my performances * SA A : D SD 

k) were structured so that I could self- ' 

pace' my le:arning throughout the week SA A D SD 

5) were- relevant in terms of providing me - * ^ . 
with a model to follow in my objective ^ 

writing efforts SA A- ' SD 

PART II WORKSHOP'- LEARNING ACTIVITIES - 

The workshop learning activities: • 

6) -were helpful to meaningful learning SA A D" 



7) were .varied enough to suit me SA A D SD 

8) afforded me options to master the 

workshop objectives SA , A D SD 

/ - 

9) helped me to learn in individual con-. 

ferences with the workshop co-leaders SA . A D SD 

10) helped Jqe to learn from my peers Mn small 

groups or in one' to one sessions SA A D SD 
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Post Workshop Evaluafion - 2 



PART III WORKSHOP CO-LEADERS - Rate the' consul tants on the following items 
by CI rcl ing one of the numbers on the scale from 5 (Highly Effective) to 
1 (ineffective) . ^ 



4 



11) presentation of materials and information / 
in full group settings 5 • ^ 3 2 1 

12) instruction in small group Settings - 5 ^ 03 2^- 1 

13) instruction in individual confererlces ' 5 ^ 3*2 1 

14) oveYall helpfulness and attitude in 

« ajding-you to solve problems '5 ^ 3 2 1 

15) organ i zat ipn of learning materials 

and-learning actiyities 5^32 1 

PART. IV EVALUATION AND FEEDBACK TECHNIQUES - Rate the followir^ .techniques 
in terms of hel'ping you to master the workshop objectives by ct ccl ing^ one 
of the numbers on" the scale from' 5 (Highly Important) to 1 (Unimportant) 

-16) pretes;: ' ' \ 5 * ^ ,3 2 1 

17) the performance, record ^ 5*^*3-2,^ 1 

18) sapr^e learning system evaluation 

/^ecksheet' . : 5 3 \ 2 * 1 

19) or5:^feedbagk . ' ' . 5 ^ 3 '2 1 

.20) written feedback * v 5 ^ . 3 2 1 

PART,V OPEN REACTIONS ' In the space below or on the back of this sheet, 
please comment on any item of the workshop. In addition, please add any 
^personal reactions which, you feel are importara.t in terms of assessing the 
value of this workshop to you. ^ 
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WEST VIRGINIA- DEPARTMENT OF EDUCATION 
•BUREAU OF LEARNING. SYSTEMS 
DIVISIpR OF INSTRUCTIONAL LEARNING SYSTEMS 

■> • * ' - ' ^ 

« # , % 

A SCALE FOR MEAaURING ATTITUDES TOWAR'D AN.Y PRACTICE* 



4 : 



DIRECTIONS: Following is a 1 i*st of statements about selected practices. 
Place a plus sign (+). before each statement with which you ajgf-ee with 
reference to the practices listed to the left of t>he statements. Please ^, 
be sure to insert the plus signs in the proper ^'box*? under the three- 
practice's listed. Hint: It would be easiest to st^rt wj^ttr^fiQe^y 
and go down that column only before starting to respond to the ot^pr c. 
practices. ; \ / 
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1. Has ^n irrestible attraction fqr me. . 

"J 

2. I like tHis practice too well to give i,t cTp. 

3. ^Serves a good purpose, * . • ^ 
k. Develops cooperation. , ^ ^- 

5. Should be appreciated by more peopl^. ^ 

6. Has advantages. , ' , * * 

7. * There is^noVeason for st<5^)ping ttiis practice.' 

0. ■ Is all right In a few caseS. ' \ \ - 

;9. My likes and dislikes for/thi s^ praQtice are balarnced. 

10. I dislike this pract i ce; t^ut ^t-^ not object, to otheirs 
1 iking i t. ^ * ^* ' ' \ ' 

U. Isn't so bad, but it is very -^jor ing'. - * ^ 

12. ^ Has .several * andes Irable features. \.. 

13. Should niot be tolerated when th.ere ^ar.e so frrany better., *5 
ones. * ' - . / ^ > .^'.^ ^ 

1^. Life^would be happjer without, this f>ractiGV^ 
^ ' #' * . • , ^ ^ 

15. It is a v7ast^ pf time and money. 
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• A^'^cal^'For M^'a^urin^ Attitudes. Toward Any Practice 
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35 .0 
iij ^ 
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THIS STAFF 
DEVELOPMENJ' 
WORKSHOP^ • 




' ! — : — 

ft 


/• ■ ' 


: 0 




4 ^ 



V 



16.^ Accompl.iSlies notJjJng worthwhile either for the 
^'hdividnal or •society* *^ 



^ 4 
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